vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #386
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.LAy9R71U2F', fmt=raw size=107374182412(finished: start all VMs, in 47.45 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: a13a4b37-12a6-4adc-9b07-23ad3e5881ad19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3h5xa0wkwiaws17413nwhgjaqhlb5yw9-nixos-system-gitlab-test/init regInfo=/nix/store/mmlk1yjs0m1ksqqa5bdx5snppq2mgzk0-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 510274560 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002734] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002745] Using GB pages for direct mapping73gitlab # [ 0.002911] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002917] ACPI: Early table checksum verification disabled75gitlab # [ 0.002921] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002925] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002929] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002935] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002938] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002939] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002941] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002942] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002944] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002945] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002945] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002946] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002946] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002947] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003170] No NUMA configuration found90gitlab # [ 0.003171] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003173] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005548] Zone ranges:93gitlab # [ 0.005548] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005550] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005551] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005552] Device empty97gitlab # [ 0.005553] Movable zone start for each node98gitlab # [ 0.005554] Early memory node ranges99gitlab # [ 0.005554] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005555] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005556] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005557] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005577] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005846] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.117935] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.118383] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.118399] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.118436] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.118438] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.118440] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.118441] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.118442] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.118443] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.118446] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.118447] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.118453] TSC deadline timer available117gitlab # [ 0.118457] CPU topo: Max. logical packages: 1118gitlab # [ 0.118458] CPU topo: Max. logical dies: 1119gitlab # [ 0.118459] CPU topo: Max. dies per package: 1120gitlab # [ 0.118462] CPU topo: Max. threads per core: 1121gitlab # [ 0.118463] CPU topo: Num. cores per package: 4122gitlab # [ 0.118464] CPU topo: Num. threads per package: 4123gitlab # [ 0.118464] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.118510] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.118528] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.118531] kvm-guest: setup PV sched yield127gitlab # [ 0.118547] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.118549] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.118550] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.118551] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.118553] Booting paravirtualized kernel on KVM132gitlab # [ 0.118557] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.123068] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.125657] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.125707] kvm-guest: PV spinlocks enabled136gitlab # [ 0.125709] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.125711] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3h5xa0wkwiaws17413nwhgjaqhlb5yw9-nixos-system-gitlab-test/init regInfo=/nix/store/mmlk1yjs0m1ksqqa5bdx5snppq2mgzk0-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.125811] Unknown kernel command line parameters "regInfo=/nix/store/mmlk1yjs0m1ksqqa5bdx5snppq2mgzk0-closure-info/registration", will be passed to user space.139gitlab # [ 0.125824] random: crng init done140gitlab # [ 0.125824] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.134991] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.139427] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.139525] software IO TLB: area num 4.144gitlab # [ 0.217155] Fallback order for Node 0: 0145gitlab # [ 0.217165] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.217167] Policy zone: Normal147gitlab # [ 0.220085] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.230789] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.244788] allocated 12582912 bytes of page_ext150gitlab # [ 0.254948] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.254950] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.255822] Dynamic Preempt: lazy153gitlab # [ 0.256008] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.256009] rcu: RCU event tracing is enabled.155gitlab # [ 0.256010] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.256011] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.256012] Rude variant of Tasks RCU enabled.158gitlab # [ 0.256012] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.256013] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.256014] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.256045] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.256046] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.256048] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.260768] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.261054] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.261064] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.261181] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.264827] Console: colour VGA+ 80x25169gitlab # [ 0.264830] printk: legacy console [tty0] enabled170gitlab # [ 0.296033] printk: legacy console [ttyS0] enabled171gitlab # [ 0.404567] ACPI: Core revision 20250807172gitlab # [ 0.405572] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.407194] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.408193] x2apic enabled175gitlab # [ 0.408995] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.409989] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.411282] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.412802] kvm-guest: setup PV IPIs179gitlab # [ 0.414420] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.415514] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.417348] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.418433] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.420357] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.422345] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.423349] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.425345] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.427345] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.428345] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.429345] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.430345] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.432352] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.433141] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.434345] active return thunk: srso_alias_return_thunk194gitlab # [ 0.435366] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.436344] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.438180] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.439344] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.440345] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.441344] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.442344] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.443345] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.445159] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.446158] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.447144] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.448135] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.449159] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.479493] Freeing SMP alternatives memory: 44K208gitlab # [ 0.480348] pid_max: default: 32768 minimum: 301209gitlab # [ 0.481269] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.482452] landlock: Up and running.211gitlab # [ 0.483122] Yama: becoming mindful.212gitlab # [ 0.484042] LSM support for eBPF active213gitlab # [ 0.484586] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.486518] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.489177] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.489917] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.490350] ... version: 2218gitlab # [ 0.491113] ... bit width: 48219gitlab # [ 0.491348] ... generic counters: 6220gitlab # [ 0.492152] ... generic bitmap: 000000000000003f221gitlab # [ 0.493126] ... fixed-purpose counters: 0222gitlab # [ 0.493347] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.494347] ... value mask: 0000ffffffffffff224gitlab # [ 0.495322] ... max period: 00007fffffffffff225gitlab # [ 0.496109] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.496467] signal: max sigframe size: 3376227gitlab # [ 0.497355] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.498208] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.499250] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.504905] smp: Bringing up secondary CPUs ...231gitlab # [ 0.505755] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.506356] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.509437] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.511139] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.512949] Memory: 6011556K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260116K reserved, 0K cma-reserved)236gitlab # [ 0.515350] devtmpfs: initialized237gitlab # [ 0.516394] x86/mm: Memory block size: 128MB238gitlab # [ 0.519505] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.520439] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.522419] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.523624] PM: RTC time: 21:01:50, date: 2026-09-18242gitlab # [ 0.527357] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.529824] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.530414] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.532496] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.533360] audit: initializing netlink subsys (disabled)247gitlab # [ 0.534404] audit: type=2000 audit(1789765310.033:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.534917] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.536347] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.537347] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.538347] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.539347] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.540361] cpuidle: using governor menu254gitlab # [ 0.542565] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.543590] PCI: Using configuration type 1 for base access256gitlab # [ 0.544348] PCI: Using configuration type 1 for extended access257gitlab # [ 0.545477] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.548474] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.549348] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.550347] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.551347] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.556523] ACPI: Added _OSI(Module Device)263gitlab # [ 0.558356] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.560354] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.567259] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.573630] ACPI: Interpreter enabled267gitlab # [ 0.574900] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.575352] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.577723] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.581353] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.583979] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.598185] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.600366] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.605592] acpiphp: Slot [3] registered275gitlab # [ 0.607472] acpiphp: Slot [4] registered276gitlab # [ 0.609460] acpiphp: Slot [5] registered277gitlab # [ 0.611473] acpiphp: Slot [6] registered278gitlab # [ 0.612428] acpiphp: Slot [7] registered279gitlab # [ 0.614428] acpiphp: Slot [8] registered280gitlab # [ 0.615433] acpiphp: Slot [9] registered281gitlab # [ 0.616437] acpiphp: Slot [10] registered282gitlab # [ 0.618435] acpiphp: Slot [11] registered283gitlab # [ 0.619436] acpiphp: Slot [12] registered284gitlab # [ 0.621436] acpiphp: Slot [13] registered285gitlab # [ 0.622394] acpiphp: Slot [14] registered286gitlab # [ 0.624389] acpiphp: Slot [15] registered287gitlab # [ 0.625389] acpiphp: Slot [16] registered288gitlab # [ 0.627406] acpiphp: Slot [17] registered289gitlab # [ 0.628390] acpiphp: Slot [18] registered290gitlab # [ 0.629377] acpiphp: Slot [19] registered291gitlab # [ 0.630138] acpiphp: Slot [20] registered292gitlab # [ 0.631378] acpiphp: Slot [21] registered293gitlab # [ 0.632139] acpiphp: Slot [22] registered294gitlab # [ 0.632367] acpiphp: Slot [23] registered295gitlab # [ 0.633131] acpiphp: Slot [24] registered296gitlab # [ 0.634380] acpiphp: Slot [25] registered297gitlab # [ 0.635107] acpiphp: Slot [26] registered298gitlab # [ 0.635368] acpiphp: Slot [27] registered299gitlab # [ 0.636136] acpiphp: Slot [28] registered300gitlab # [ 0.637371] acpiphp: Slot [29] registered301gitlab # [ 0.638103] acpiphp: Slot [30] registered302gitlab # [ 0.638367] acpiphp: Slot [31] registered303gitlab # [ 0.639109] PCI host bridge to bus 0000:00304gitlab # [ 0.640352] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.641403] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.644361] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.647358] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.650355] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.654357] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.657131] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.661690] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.666510] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.674445] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.676449] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.679354] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.681353] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.684354] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.687878] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.693432] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.697617] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.701972] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.704369] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.707538] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.724545] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.726364] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.727396] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.729878] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.734137] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.740386] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.741288] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.742151] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.755355] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.757920] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.763389] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.764347] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.765395] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.767656] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.772384] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.773429] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.776410] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.783006] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.794551] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.797368] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.799408] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.806158] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.816377] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.818365] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.820396] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.825869] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.832366] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.834377] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.835371] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.837847] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.843379] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.845367] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.847396] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.849363] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.854166] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.861395] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.863396] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.867864] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.876400] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.877364] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.880417] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.884906] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.891382] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.893364] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.894395] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.901421] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.902519] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.903491] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.904484] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.906471] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.908702] iommu: Default domain type: Translated375gitlab # [ 0.909348] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.911629] ACPI: bus type USB registered377gitlab # [ 0.912428] usbcore: registered new interface driver usbfs378gitlab # [ 0.913363] usbcore: registered new interface driver hub379gitlab # [ 0.914305] usbcore: registered new device driver usb380gitlab # [ 0.916484] NetLabel: Initializing381gitlab # [ 0.917221] NetLabel: domain hash size = 128382gitlab # [ 0.917938] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.919405] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.920357] PCI: Using ACPI for IRQ routing385gitlab # [ 0.921593] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.922343] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.922343] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.925351] vgaarb: loaded389gitlab # [ 0.926102] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.926348] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.930427] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.932057] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.932828] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.934460] pnp: PnP ACPI init395gitlab # [ 0.935624] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.945207] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.948240] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.950393] NET: Registered PF_INET protocol family399gitlab # [ 0.954499] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.976769] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.978412] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.979834] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.985702] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.988410] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.991337] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.994502] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.997322] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 1.000058] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 1.002080] NET: Registered PF_XDP protocol family410gitlab # [ 1.003872] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 1.005936] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 1.007168] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 1.008344] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 1.009547] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 1.010944] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 1.011987] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 1.014589] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 1.017265] PCI: CLS 0 bytes, default 64419gitlab # [ 1.018086] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 1.018829] Trying to unpack rootfs image as initramfs...421gitlab # [ 1.019204] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 1.019361] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.042950] Initialise system trusted keyrings424gitlab # [ 1.044308] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.056074] Key type asymmetric registered426gitlab # [ 1.056877] Asymmetric key parser 'x509' registered427gitlab # [ 1.057884] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.059565] io scheduler mq-deadline registered429gitlab # [ 1.060374] io scheduler kyber registered430gitlab # [ 1.063938] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.065344] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.067865] Linux agpgart interface v0.103433gitlab # [ 1.068708] ACPI: bus type drm_connector registered434gitlab # [ 1.072054] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.073205] usbserial: USB Serial support registered for generic436gitlab # [ 1.074269] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.074269] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.076660] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.078121] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.079411] NET: Registered PF_INET6 protocol family441gitlab # [ 1.081247] Segment Routing with IPv6442gitlab # [ 1.081999] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.084857] IPI shorthand broadcast: enabled444gitlab # [ 1.089414] sched_clock: Marking stable (941016779, 148280298)->(1111124684, -21827607)445gitlab # [ 1.091318] registered taskstats version 1446gitlab # [ 1.092405] Loading compiled-in X.509 certificates447gitlab # [ 1.102385] Demotion targets for Node 0: null448gitlab # [ 1.103500] Key type .fscrypt registered449gitlab # [ 1.104202] Key type fscrypt-provisioning registered450gitlab # [ 1.105189] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.106136] ima: Allocated hash algorithm: sha1452gitlab # [ 1.107034] ima: No architecture policies found453gitlab # [ 1.108169] PM: Magic number: 10:561:45454gitlab # [ 1.109941] RAS: Correctable Errors collector initialized.455gitlab # [ 1.114510] clk: Disabling unused clocks456gitlab # [ 1.115223] PM: genpd: Disabling unused power domains457gitlab # [ 1.311228] Freeing initrd memory: 29392K458gitlab # [ 1.318673] Freeing unused decrypted memory: 2028K459gitlab # [ 1.325085] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.327857] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.332775] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.336733] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.405070] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.406253] Run /init as init process465gitlab # [ 1.420420] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.444368] fuse: init (API version 7.45)467gitlab # [ 1.452946] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.460050] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.463515] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.500553] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.836559] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.853663] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.854582] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.855529] systemd[1]: Running in initrd.475gitlab # [ 1.856655] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.857894] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.960586] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.007137] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.017120] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.018357] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.019803] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.021032] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.022184] systemd[1]: Reached target Path Units.484gitlab # [ 2.023081] systemd[1]: Reached target Slice Units.485gitlab # [ 2.024016] systemd[1]: Reached target Swaps.486gitlab # [ 2.024912] systemd[1]: Reached target Timer Units.487gitlab # [ 2.025976] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.027236] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.028455] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.029502] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.030558] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.031575] systemd[1]: Reached target Socket Units.493gitlab # [ 2.033729] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.035948] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.038027] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.040856] systemd[1]: Starting Journal Service...497gitlab # [ 2.050365] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.054403] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.062691] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.064884] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.072981] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.075628] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.076940] systemd-journald[90]: Collecting audit messages is disabled.504gitlab # [ 2.076983] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.087427] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.096409] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.107406] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508gitlab # [ 2.111871] netfs: FS-Cache loaded509gitlab # [ 2.111952] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.510gitlab # [ 2.115098] systemd[1]: Starting Create Static Device Nodes in /dev...511gitlab # [ 2.118987] systemd[1]: Finished Load Kernel Modules.512gitlab # [ 2.119684] 9pnet: Installing 9P2000 support513gitlab # [ 2.122424] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.126466] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.128389] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 2.131149] systemd[1]: Started Journal Service.517gitlab # [ 1.984300] systemd-modules-load[92]: Using 4 probe threads518gitlab # [ 1.985600] systemd-modules-load[92]: Inserted module 'virtio_balloon'519gitlab # [ 1.986738] systemd-modules-load[92]: Inserted module 'dm_mod'520gitlab # [ 1.987823] systemd-modules-load[92]: Inserted module 'virtio_gpu'521gitlab # [ 1.989108] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.994733] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.995737] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.996683] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.997586] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.998745] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.013184] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.023496] systemd-udevd[112]: Using default interface naming scheme 'v261'.529gitlab # [ 2.033989] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.058804] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.059732] systemd[1]: Reached target System Initialization.532gitlab # [ 2.060617] systemd[1]: Reached target Basic System.533gitlab # [ 2.282774] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.283660] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.285495] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.286753] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.287519] SCSI subsystem initialized538gitlab # [ 2.287867] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.290390] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.290541] virtio_blk virtio4: 4/0/0 default/read/poll queues541gitlab # [ 2.290741] usb usb1: Product: UHCI Host Controller542gitlab # [ 2.293872] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.295011] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.297372] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)545gitlab # [ 2.301610] hub 1-0:1.0: USB hub found546gitlab # [ 2.303831] hub 1-0:1.0: 2 ports detected547gitlab # [ 2.305320] virtio_blk virtio5: 4/0/0 default/read/poll queues548gitlab # [ 2.312826] virtio_blk virtio5: [vdb] 11843752 512-byte logical blocks (6.06 GB/5.65 GiB)549gitlab # [ 2.314691] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.319181] serio: i8042 KBD port at 0x60,0x64 irq 1551gitlab # [ 2.319952] serio: i8042 AUX port at 0x60,0x64 irq 12552gitlab # [ 2.325751] scsi host0: ata_piix553gitlab # [ 2.326766] scsi host1: ata_piix554gitlab # [ 2.328056] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.329385] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.209329] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 2.217186] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line.558gitlab # [ 2.219070] (udev-worker)[117]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.223265] (udev-worker)[117]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.224744] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.225884] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.227168] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.230464] systemd-vconsole-setup[151]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 2.232371] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 2.240161] systemd[1]: Found device /dev/disk/by-label/nix-store.566gitlab # [ 2.248595] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.251904] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.490867] ata2: found unknown device (class 0)569gitlab # [ 2.492157] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.494392] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.522049] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0572gitlab # [ 2.538367] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.552131] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.577655] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.707182] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.710238] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.712946] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.714647] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.716123] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.747360] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.758455] usbcore: registered new interface driver usbhid582gitlab # [ 2.760115] usbhid: USB HID core driver583gitlab # [ 2.767694] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.771334] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.919754] systemd[1]: Mounting /sysroot...586gitlab # [ 3.225199] EXT4-fs (vda): mounted filesystem a13a4b37-12a6-4adc-9b07-23ad3e5881ad r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.082855] systemd[1]: Mounted /sysroot.588gitlab # [ 3.084433] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.086993] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.089127] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.091215] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.093174] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.096282] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.101274] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.257458] 9p: Installing v9fs 9p2000 file system support596gitlab # [ 3.118106] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.597gitlab # [ 3.120274] systemd[1]: Mounted /sysroot/run.598gitlab # [ 3.121188] systemd[1]: Mount[ 3.269472] erofs (device vdb): mounted with root inode @ nid 128.599gitlab # ed /sysroot/nix/.rw-store.600gitlab # [ 3.122732] systemd[1]: Mounted /sysroot/tmp/shared.601gitlab # [ 3.124484] systemd[1]: Mounted /sysroot/tmp/xchg.602gitlab # [ 3.125259] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.132553] systemd[1]: Starting rw-sysroot-nix-store.service...604gitlab # [ 3.133459] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...605gitlab # [ 3.134939] systemd[1]: Reloading...606gitlab # [ 3.193199] systemd[1]: Reloading finished in 59 ms.607gitlab # [ 3.221819] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...608gitlab # [ 3.224678] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.227146] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.229108] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.231650] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.233584] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.235704] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.237719] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.247958] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.250223] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.920123] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.969211] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.971180] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.973349] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.975198] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.004079] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.006711] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.023290] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.025168] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.027115] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.059682] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.061745] systemd[1]: Stopped target Basic System.629gitlab # [ 4.063503] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.065346] systemd[1]: Stopped target Path Units.631gitlab # [ 4.067093] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.069536] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.072129] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.073826] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.075616] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.078791] systemd[1]: Stopped target Swaps.637gitlab # [ 4.081339] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.084350] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.086428] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.088426] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.090833] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.092464] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.095825] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.097494] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.099338] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.100851] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.102911] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.104442] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.106520] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.108610] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.110550] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.112260] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.113758] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.115590] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.116937] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.117898] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.119141] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.120260] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.121143] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.122217] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.123287] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.124645] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.125556] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.126614] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.127714] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.128801] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.129622] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.130518] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.131673] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.132619] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.133931] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.134993] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.135987] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.136879] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.137895] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.138646] systemd[1]: Reached target Switch Root.677gitlab # [ 4.139405] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.218342] initrd-nixos-activation-start[226]: booting system configuration /nix/store/3h5xa0wkwiaws17413nwhgjaqhlb5yw9-nixos-system-gitlab-test679gitlab # [ 4.251740] initrd-nixos-activation-start[226]: running activation script...680gitlab # [ 4.474802] initrd-nixos-activation-start[249]: setting up /etc...681gitlab # [ 4.580557] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.583239] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.584907] systemd[1]: Starting Switch Root...684gitlab # [ 4.602795] systemd[1]: Switching root.685gitlab # [ 4.812475] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.913970] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.286597] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.296704] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.298540] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.300472] systemd[1]: Detected first boot.691gitlab # [ 5.303026] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.472916] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.557039] systemd[1]: Applying preset policy.694gitlab # [ 5.741663] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.859918] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.861324] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.863684] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.865791] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.867220] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.868828] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.869791] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.871040] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.872150] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.873003] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.873789] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.874628] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.875381] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.876206] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.877088] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.878036] systemd[1]: Reached target Path Units.711gitlab # [ 5.878764] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.879580] systemd[1]: Reached target Slice Units.713gitlab # [ 5.880308] systemd[1]: Reached target Swaps.714gitlab # [ 5.881793] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.883814] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.885173] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.886851] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.887804] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.890236] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.891649] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.893565] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.894752] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.895879] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.897197] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.900079] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.901146] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.902045] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.904978] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.907117] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.909135] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.912349] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.916674] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.917813] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.920815] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.921736] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.923248] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.931856] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.948101] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.950385] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.960029] systemd[1]: Starting Journal Service...741gitlab # [ 5.964163] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.972436] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.976452] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.978507] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.983442] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.990720] systemd-journald[320]: Collecting audit messages is enabled.747gitlab # [ 5.991287] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 5.993410] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 5.994416] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 5.995442] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 5.996396] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 5.997396] EXT4-fs (vda): re-mounted a13a4b37-12a6-4adc-9b07-23ad3e5881ad.753gitlab # [ 6.001576] systemd[1]: Finished Create List of Static Device Nodes.754gitlab # [ 6.003813] systemd[1]: modprobe@configfs.service: Deactivated successfully.755gitlab # [ 6.005219] systemd[1]: Finished Load Kernel Module configfs.756gitlab # [ 5.858160] systemd[1]: Queued start job for default target Multi-User System.757gitlab # [ 6.007502] systemd[1]: Started Journal Service.758gitlab # [ 6.007901] loop: module loaded759gitlab # [ 5.862380] systemd[1]: Unnecessary job was removed for /dev/vdb.760gitlab # [ 5.863708] systemd[1]: systemd-journald.service: Deactivated successfully.761gitlab # [ 5.865068] systemd-modules-load[321]: Using 3 probe threads762gitlab # [ 5.866091] systemd-modules-load[321]: Inserted module 'tls'763gitlab # [ 5.867103] systemd[1]: Mounted FUSE Control File System.764gitlab # [ 5.868119] systemd-modules-load[321]: Inserted module 'loop'765gitlab # [ 5.869188] systemd[1]: Finished Remount Root and Kernel File Systems.766gitlab # [ 5.870400] systemd[1]: Finished Load Kernel Modules.767gitlab # [ 5.871461] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.872586] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 5.873689] systemd[1]: Starting Firewall...770gitlab # [ 5.874464] systemd[1]: Starting Flush Journal to Persistent Storage...771gitlab # [ 5.875460] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 5.877087] systemd[1]: Starting Load/Save OS Random Seed...773gitlab # [ 5.878118] systemd-oomd[323]: No swap; memory pressure usage will be degraded774gitlab # [ 5.882185] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 5.884138] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 5.885254] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 6.034903] systemd-journald[320]: Received client request to flush runtime journal.778gitlab # [ 5.930153] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 5.932494] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 5.933509] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.934958] systemd[1]: Reached target First Boot Complete.782gitlab # [ 5.935923] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 5.936839] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 5.937909] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 5.938794] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 5.940165] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 5.941637] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 5.942649] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 5.969866] systemd-udevd[366]: Using default interface naming scheme 'v261'.790gitlab # [ 5.984451] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.000400] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.067445] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.097072] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.115475] systemd[1]: Finished Firewall.795gitlab # [ 6.118478] (udev-worker)[427]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 6.120582] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.121824] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.798gitlab # [ 6.129858] (udev-worker)[442]: Network interface NamePolicy= disabled on kernel command line.799gitlab # [ 6.136085] systemd[1]: Condition check resulted in Virtio network device being skipped.800gitlab # [ 6.137553] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore801gitlab # [ 6.139028] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67802gitlab # [ 6.141245] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore803gitlab # [ 6.142918] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.144276] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os805gitlab # [ 6.311664] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 6.314133] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0807gitlab # [ 6.316091] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD808gitlab # [ 6.317353] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3809gitlab # [ 6.330146] Console: switching to colour dummy device 80x25810gitlab # [ 6.332676] [drm] Found bochs VGA, ID 0xb0c5.811gitlab # [ 6.332678] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.812gitlab # [ 6.333751] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 6.335411] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 6.340508] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5815gitlab # [ 6.346350] ACPI: button: Power Button [PWRF]816gitlab # [ 6.350448] Console: switching to colour frame buffer device 160x50817gitlab # [ 6.352464] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device818gitlab # [ 6.354444] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4819gitlab # [ 6.357813] rtc_cmos 00:05: RTC can wake from S4820gitlab # [ 6.359770] rtc_cmos 00:05: registered as rtc0821gitlab # [ 6.361173] rtc_cmos 00:05: setting system clock to 2026-09-18T21:01:55 UTC (1789765315)822gitlab # [ 6.363541] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs823gitlab # [ 6.365285] parport_pc 00:03: reported by Plug and Play ACPI824gitlab # [ 6.369047] systemd-journald[320]: Time jumped backwards, rotating.825gitlab # [ 6.370949] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6826gitlab # [ 6.373336] Floppy drive(s): fd0 is 2.88M AMI BIOS827gitlab # [ 6.374678] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]828gitlab # [ 6.384875] FDC 0 is a S82078B829gitlab # [ 6.400730] mousedev: PS/2 mouse device common for all mice830gitlab # [ 6.307172] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.319847] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.337079] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.498450] ppdev: user-space parallel port driver834gitlab # [ 6.365233] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.560044] kvm_amd: TSC scaling supported836gitlab # [ 6.560792] kvm_amd: Nested Virtualization enabled837gitlab # [ 6.561451] kvm_amd: Nested Paging enabled838gitlab # [ 6.561867] kvm_amd: LBR virtualization supported839gitlab # [ 6.562448] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.563046] kvm_amd: Virtual GIF supported841gitlab # [ 6.563698] kvm_amd: Virtual NMI enabled842gitlab # [ 6.599222] EDAC MC: Ver: 3.0.0843gitlab # [ 6.460548] systemd-vconsole-setup[493]: Configuration of first virtual console was skipped, ignoring remaining ones.844gitlab # [ 6.462944] systemd[1]: Finished Virtual Console Setup.845gitlab # [ 6.717678] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.747696] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.750604] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.753918] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.758743] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.763077] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.765104] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.776675] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.779516] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.815948] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855gitlab # [ 6.822506] systemd[1]: Finished Save Transient machine-id to Disk.856gitlab # [ 6.827281] systemd[1]: Finished Create System Files and Directories.857gitlab # [ 6.833871] systemd[1]: Starting Rebuild Journal Catalog...858gitlab # [ 6.836086] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859gitlab # [ 6.856625] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.868178] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.869670] systemd[1]: Starting Update is Completed...862gitlab # [ 6.885973] systemd[1]: Finished Update is Completed.863gitlab # [ 6.940653] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.943742] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 7.171081] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 7.173651] systemd[1]: Reached target System Initialization.867gitlab # [ 7.176181] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 7.178617] systemd[1]: Started logrotate.timer.869gitlab # [ 7.180187] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 7.182491] systemd[1]: Reached target Timer Units.871gitlab # [ 7.184427] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 7.186694] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 7.198498] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 7.200319] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 7.202963] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 7.204830] systemd[1]: Reached target Socket Units.877gitlab # [ 7.206420] systemd[1]: Starting D-Bus System Message Bus...878gitlab # [ 7.284738] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.288006] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.290809] dbus-broker-launch[575]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.296603] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.312849] dbus-broker-launch[575]: Ready883gitlab # [ 7.315748] systemd[1]: Reached target Basic System.884gitlab # [ 7.318797] systemd[1]: Started backdoor.service.885gitlab # [ 7.321984] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.325656] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.337171] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.344473] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.351600] systemd[1]: Starting Post-Boot Actions...890gitlab # connecting to host...891gitlab # [ 7.357673] systemd[1]: Started Reset console on configuration changes.892gitlab # [ 7.362699] systemd[1]: Starting resolvconf update...893gitlab # [ 7.375336] logrotate[580]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.375527] logrotate[580]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # [ 7.376752] logrotate[580]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 7.380645] logrotate[580]: Reading state from file: /var/lib/logrotate.status897gitlab # [ 7.381594] logrotate[580]: state file /var/lib/logrotate.status does not exist898gitlab # [ 7.381929] logrotate[580]: Allocating hash table for state file, size 64 entries899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab # [ 7.388127] logrotate[580]: Handling 4 logs901gitlab # [ 7.388632] logrotate[580]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed902gitlab # [ 7.389918] logrotate[580]: considering log /var/log/btmp903gitlab # [ 7.390163] logrotate[580]: Creating new state904gitlab: connected to guest root shell905gitlab # [ 7.390643] logrotate[580]: Now: 2026-09-18 21:01906gitlab: (connecting took 8.07 seconds)907gitlab # [ 7.391128] logrotate[580]: Last rotated at 2026-09-18 21:00908gitlab: (finished: waiting for the VM to finish booting, in 8.08 seconds)909gitlab # [ 7.391770] logrotate[580]: log does not need rotating (log has already been rotated)910gitlab # [ 7.393335] logrotate[580]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 7.393881] logrotate[580]: considering log /var/log/wtmp912gitlab # [ 7.394482] logrotate[580]: Creating new state913gitlab # [ 7.395088] logrotate[580]: Now: 2026-09-18 21:01914gitlab # [ 7.395539] logrotate[580]: Last rotated at 2026-09-18 21:00915gitlab # [ 7.396052] logrotate[580]: log does not need rotating (log has already been rotated)916gitlab # [ 7.396470] logrotate[580]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab # [ 7.397031] logrotate[580]: switching euid from 0 to 165 and egid from 0 to 165 (pid 580)918gitlab # [ 7.397497] logrotate[580]: considering log /var/gitlab/state/log/*.log919gitlab # [ 7.398110] logrotate[580]: log /var/gitlab/state/log/*.log does not exist -- skipping920gitlab # [ 7.398566] logrotate[580]: Creating new state921gitlab # [ 7.399164] logrotate[580]: switching euid from 165 to 0 and egid from 165 to 0 (pid 580)922gitlab # [ 7.399698] logrotate[580]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed923gitlab # [ 7.400283] logrotate[580]: switching euid from 0 to 60 and egid from 0 to 60 (pid 580)924gitlab # [ 7.400769] logrotate[580]: considering log /var/log/nginx/*.log925gitlab # [ 7.401399] logrotate[580]: log /var/log/nginx/*.log does not exist -- skipping926gitlab # [ 7.401832] logrotate[580]: Creating new state927gitlab # [ 7.402456] logrotate[580]: not running postrotate script, since no logs were rotated928gitlab # [ 7.402938] logrotate[580]: switching euid from 60 to 0 and egid from 60 to 0 (pid 580)929gitlab # [ 7.403887] nsncd[581]: Sep 18 21:01:56.679 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab # [ 7.404614] systemd[1]: Finished Logrotate configuration check.931gitlab # [ 7.405573] systemd[1]: Finished Post-Boot Actions.932gitlab # [ 7.406196] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab # [ 7.406815] systemd[1]: Finished Import lastlog data into lastlog2 database.934gitlab # [ 7.422413] systemd[1]: Reached target Host and Network Name Lookups.935gitlab # [ 7.422797] systemd[1]: Reached target User and Group Name Lookups.936gitlab # [ 7.426696] systemd[1]: Starting User Login Management...937gitlab # [ 7.450708] systemd[1]: Stopped target Host and Network Name Lookups.938gitlab # [ 7.451807] systemd[1]: Stopping Host and Network Name Lookups...939gitlab # [ 7.452715] systemd[1]: Stopped target User and Group Name Lookups.940gitlab # [ 7.453800] systemd[1]: Stopping User and Group Name Lookups...941gitlab # [ 7.454739] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...942gitlab # [ 7.455667] systemd[1]: nscd.service: Deactivated successfully.943gitlab # [ 7.456578] systemd[1]: Stopped Name Service Cache Daemon (nsncd).944gitlab # [ 7.457667] systemd[1]: nscd.service: Consumed 24ms CPU time over 109ms wall clock time, 7M memory peak, 5.5M read from disk.945gitlab # [ 7.459522] systemd[1]: Starting Name Service Cache Daemon (nsncd)...946gitlab # [ 7.473562] systemd-logind[634]: New seat seat0.947gitlab # [ 7.476720] systemd[1]: Started Name Service Cache Daemon (nsncd).948gitlab # [ 7.477727] systemd-logind[634]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 7.479325] nsncd[672]: Sep 18 21:01:56.765 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"950gitlab # [ 7.481517] systemd-logind[634]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)951gitlab # [ 7.482842] systemd-logind[634]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)952gitlab # [ 7.484338] systemd[1]: Started User Login Management.953gitlab # [ 7.485122] systemd[1]: Finished resolvconf update.954gitlab # [ 7.486292] systemd[1]: Reached target Preparation for Network.955gitlab # [ 7.487475] systemd[1]: Reached target Host and Network Name Lookups.956gitlab # [ 7.487794] systemd[1]: Reached target User and Group Name Lookups.957gitlab # [ 7.489578] systemd[1]: Starting DHCP Client...958gitlab # [ 7.490693] systemd[1]: Starting linger-users.service...959gitlab # [ 7.492400] systemd[1]: Starting Address configuration of eth1...960gitlab # [ 7.494318] systemd[1]: Starting Extra networking commands....961gitlab # [ 7.511603] systemd[1]: linger-users.service: Deactivated successfully.962gitlab # [ 7.512312] systemd[1]: Finished linger-users.service.963gitlab # [ 7.524626] network-addresses-eth1-start[696]: adding address 192.168.1.1/24... done964gitlab # [ 7.528466] network-addresses-eth1-start[696]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.534547] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.563496] dhcpcd[707]: dhcpcd-10.3.2 starting967gitlab # [ 7.566073] dhcpcd[762]: dev: loaded udev968gitlab # [ 7.566437] systemd[1]: Finished Extra networking commands..969gitlab # [ 7.566916] systemd[1]: Reached target Network.970gitlab # [ 7.567662] systemd[1]: Starting gitlab-workhorse.service...971gitlab # [ 7.572806] systemd[1]: Starting Nginx Web Server...972gitlab # [ 7.722171] 8021q: 802.1Q VLAN Support v1.8973gitlab # [ 7.722913] 8021q: adding VLAN 0 to HW filter on device eth1974gitlab # [ 7.577074] systemd[1]: Starting PostgreSQL Server...975gitlab # [ 7.577471] systemd[1]: Starting Redis Server - redis-gitlab...976gitlab # [ 7.578121] systemd[1]: Starting Permit User Sessions...977gitlab # [ 7.590889] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.978gitlab # [ 7.600633] systemd[1]: Finished Permit User Sessions.979gitlab # [ 7.602928] systemd[1]: Started Getty on tty1.980gitlab # [ 7.604440] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.818757] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.823965] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.825286] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.827019] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.828631] cfg80211: failed to load regulatory.db986gitlab # [ 7.692623] nginx-pre-start[785]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 7.693154] nginx-pre-start[785]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 7.698202] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.857765] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.712462] dhcpcd[762]: eth0: waiting for carrier991gitlab # [ 7.712623] dhcpcd[762]: eth0: carrier acquired992gitlab # [ 7.717671] dhcpcd[762]: DUID 00:01:00:01:32:40:63:45:52:54:00:12:34:56993gitlab # [ 7.717982] dhcpcd[762]: eth0: IAID 00:12:34:56994gitlab # [ 7.720063] dhcpcd[762]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 7.726692] postgresql-pre-start[790]: The files belonging to this database system will be owned by user "postgres".996gitlab # [ 7.728845] postgresql-pre-start[790]: This user must also own the server process.997gitlab # [ 7.732106] postgresql-pre-start[790]: The database cluster will be initialized with locale "en_US.UTF-8".998gitlab # [ 7.732451] postgresql-pre-start[790]: The default database encoding has accordingly been set to "UTF8".999gitlab # [ 7.732980] postgresql-pre-start[790]: The default text search configuration will be set to "english".1000gitlab # [ 7.733714] postgresql-pre-start[790]: Data page checksums are enabled.1001gitlab # [ 7.734508] postgresql-pre-start[790]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1002gitlab # [ 7.738822] postgresql-pre-start[790]: creating subdirectories ... ok1003gitlab # [ 7.739317] postgresql-pre-start[790]: selecting dynamic shared memory implementation ... posix1004gitlab # [ 7.744364] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1005gitlab # [ 7.746539] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1006gitlab # [ 7.748545] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started1007gitlab # [ 7.750535] systemd[1]: Started Redis Server - redis-gitlab.1008gitlab # [ 7.750838] redis-server[789]: Configuration loaded1009gitlab # [ 7.751323] redis[789]: monotonic clock: POSIX clock_gettime1010gitlab # [ 7.751815] redis[789]: Running mode=standalone, port=0.1011gitlab # [ 7.752381] redis[789]: Server initialized1012gitlab # [ 7.752815] redis[789]: Ready to accept connections unix1013gitlab # [ 7.754545] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1014gitlab # [ 7.774100] postgresql-pre-start[790]: selecting default "max_connections" ... 1001015gitlab # [ 7.810529] postgresql-pre-start[790]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 8.138314] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.234870] postgresql-pre-start[790]: selecting default time zone ... UTC1018gitlab # [ 8.237769] postgresql-pre-start[790]: creating configuration files ... ok1019gitlab # [ 8.332960] gitlab-workhorse[823]: time="2026-09-18T21:01:57Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.339270] gitlab-workhorse[823]: time="2026-09-18T21:01:57Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.340667] gitlab-workhorse[823]: time="2026-09-18T21:01:57Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.375441] dhcpcd[762]: eth0: soliciting a DHCP lease1023gitlab # [ 8.530268] NET: Registered PF_PACKET protocol family1024gitlab # [ 8.389769] dhcpcd[762]: eth0: offered 10.0.2.15 from 10.0.2.21025gitlab # [ 8.395177] dhcpcd[762]: eth0: probing address 10.0.2.15/241026gitlab # [ 8.424388] postgresql-pre-start[790]: running bootstrap script ... ok1027gitlab # [ 8.859451] postgresql-pre-start[790]: performing post-bootstrap initialization ... ok1028gitlab # [ 9.161783] postgresql-pre-start[790]: syncing data to disk ... ok1029gitlab # [ 9.164179] postgresql-pre-start[790]: initdb: warning: enabling "trust" authentication for local connections1030gitlab # [ 9.167298] postgresql-pre-start[790]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1031gitlab # [ 9.172085] postgresql-pre-start[790]: Success. You can now start the database server using:1032gitlab # [ 9.174832] postgresql-pre-start[790]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1033gitlab # [ 9.276280] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1034gitlab # [ 9.280648] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 54321035gitlab # [ 9.281438] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 54321036gitlab # [ 9.289879] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1037gitlab # [ 9.305461] postgres[858]: [858] LOG: database system was shut down at 2026-09-18 21:01:58 GMT1038gitlab # [ 9.314122] postgres[849]: [849] LOG: database system is ready to accept connections1039gitlab # [ 9.322074] systemd[1]: Started PostgreSQL Server.1040gitlab # [ 9.326620] systemd[1]: Starting PostgreSQL Setup Scripts...1041gitlab # [ 9.530551] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[866]: mkdir -p /var/gitlab/state/home/.ssh: OK1042gitlab # [ 9.533320] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[866]: chmod 700 /var/gitlab/state/home/.ssh: OK1043gitlab # [ 9.553122] postgresql-setup-start[874]: CREATE DATABASE1044gitlab # [ 9.575940] postgresql-setup-start[898]: CREATE ROLE1045gitlab # [ 9.581240] systemd[1]: Finished gitlab-config.service.1046gitlab # [ 9.583140] systemd[1]: Started gitaly.service.1047gitlab # [ 9.588104] postgresql-setup-start[901]: ALTER DATABASE1048gitlab # [ 9.608232] postgresql-setup-start[909]: CREATE ROLE1049gitlab # [ 9.610220] systemd[1]: Finished PostgreSQL Setup Scripts.1050gitlab # [ 9.611143] systemd[1]: Reached target PostgreSQL.1051gitlab # [ 9.612997] systemd[1]: Starting gitlab-db-config.service...1052gitlab # [ 9.614057] systemd[1]: Starting gitlab-postgresql.service...1053gitlab # [ 9.706436] gitlab-postgresql-start[919]: CREATE DATABASE1054gitlab # [ 9.719230] dhcpcd[762]: eth0: soliciting an IPv6 router1055gitlab # [ 9.719854] dhcpcd[762]: eth0: Router Advertisement from fe80::21056gitlab # [ 9.721068] dhcpcd[762]: eth0: adding address fec0::5054:ff:fe12:3456/641057gitlab # [ 9.721466] dhcpcd[762]: eth0: adding route to fec0::/641058gitlab # [ 9.722755] dhcpcd[762]: eth0: adding default route via fe80::21059gitlab # [ 9.753815] gitlab-postgresql-start[924]: CREATE EXTENSION1060gitlab # [ 9.848732] gitlab-postgresql-start[931]: CREATE EXTENSION1061gitlab # [ 9.853262] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 10.082989] gitaly[904]: time="2026-09-18T21:01:59.369Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9041063gitlab # [ 10.083887] gitaly[904]: time="2026-09-18T21:01:59.369Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9041064gitlab # [ 10.085346] gitaly[904]: time="2026-09-18T21:01:59.369Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9041065gitlab # [ 10.086439] gitaly[904]: time="2026-09-18T21:01:59.369Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9041066gitlab # [ 10.087910] gitaly[904]: time="2026-09-18T21:01:59.369Z" level=info msg="Starting Gitaly" pid=904 version=1067gitlab # [ 10.269023] gitaly[904]: time="2026-09-18T21:01:59.555Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=185 pid=9041068gitlab # [ 10.269343] gitaly[904]: time="2026-09-18T21:01:59.556Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9041069gitlab # [ 10.269862] gitaly[904]: time="2026-09-18T21:01:59.556Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9041070gitlab # [ 10.270650] gitaly[904]: time="2026-09-18T21:01:59.556Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-904/git-exec-611150581.d/git pid=9041071gitlab # [ 10.279855] gitaly[904]: time="2026-09-18T21:01:59.566Z" level=info msg="finished detecting git version" duration_ms=10 pid=9041072gitlab # [ 10.280231] gitaly[904]: time="2026-09-18T21:01:59.566Z" level=info msg="using Git version" pid=904 version=2.53.g1073gitlab # [ 10.283085] gitaly[904]: time="2026-09-18T21:01:59.570Z" level=info msg="clearing disk cache object folder" pid=904 storage=default1074gitlab # [ 10.283271] gitaly[904]: time="2026-09-18T21:01:59.570Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache879410510 pid=904 storage=default1075gitlab # [ 10.283745] gitaly[904]: time="2026-09-18T21:01:59.570Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache879410510 pid=904 storage=default1076gitlab # [ 10.284618] gitaly[904]: time="2026-09-18T21:01:59.570Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9041077gitlab # [ 10.285120] gitaly[904]: time="2026-09-18T21:01:59.570Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9041078gitlab # [ 10.285723] gitaly[904]: time="2026-09-18T21:01:59.570Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache879410510 clear_duration_ms=0 pid=904 storage=default1079gitlab # [ 10.318678] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9041080gitlab # [ 10.321413] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="counting repositories" pid=9041081gitlab # [ 10.321745] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="starting to count repositories" pid=904 storage_path=/var/gitlab/state/repositories1082gitlab # [ 10.322634] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=904 schema=unix1083gitlab # [ 10.322958] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="listening at address" address=/run/gitaly/gitaly-904/sock.d/intern pid=904 schema=unix1084gitlab # [ 10.323176] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=904 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.323829] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9041086gitlab # [ 10.324657] gitaly[904]: time="2026-09-18T21:01:59.605Z" level=info msg="finished tempdir cleaner walk" pid=904 storage=default time_ms=01087gitlab # [ 10.325515] gitaly[904]: time="2026-09-18T21:01:59.606Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9041088gitlab # [ 10.326187] gitaly[904]: time="2026-09-18T21:01:59.606Z" level=info msg="Started Gitaly" duration_ms=237 pid=9041089gitlab # [ 10.326818] gitaly[904]: time="2026-09-18T21:01:59.606Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9041090gitlab # [ 10.327659] gitaly[904]: time="2026-09-18T21:01:59.607Z" level=info msg="maintenance: daily scheduled" pid=904 scheduled="2026-09-19 12:00:00 +0000 UTC"1091gitlab # [ 11.085175] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 11.085826] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 11.110379] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 12.250512] gitaly[904]: time="2026-09-18T21:02:01.536Z" level=info msg="License database preloaded" duration_ms=2166 pid=9041095gitlab # [ 13.751877] dhcpcd[762]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 13.752517] dhcpcd[762]: eth0: adding route to 10.0.2.0/241097gitlab # [ 13.753246] dhcpcd[762]: eth0: adding default route via 10.0.2.21098gitlab # [ 13.845903] systemd[1]: Started DHCP Client.1099gitlab # [ 13.846673] systemd[1]: Reached target Network is Online.1100gitlab # [ 41.299436] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: W, [2026-09-18T21:02:30.585555 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 43.267551] postgres[1310]: [1310] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 43.268204] postgres[1310]: [1310] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 43.268949] postgres[1310]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 43.270150] postgres[1310]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 43.271112] postgres[1310]: attidentity AS identity,1106gitlab # [ 43.271924] postgres[1310]: attgenerated as attgenerated1107gitlab # [ 43.272995] postgres[1310]: FROM pg_attribute a1108gitlab # [ 43.274078] postgres[1310]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 43.274752] postgres[1310]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 43.275737] postgres[1310]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 43.276717] postgres[1310]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 43.277717] postgres[1310]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 43.278803] postgres[1310]: ORDER BY a.attnum1114gitlab # [ 43.279653] postgres[1310]:1115gitlab # [ 46.998658] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1348]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 46.999221] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1348]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.401062] gitlab-workhorse[823]: time="2026-09-18T21:02:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.411233] gitlab-workhorse[823]: time="2026-09-18T21:02:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 61.930296] postgres[1423]: [1423] ERROR: relation "table_without_models" does not exist1120gitlab # [ 61.931181] postgres[1423]: [1423] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.412237] gitlab-workhorse[823]: time="2026-09-18T21:02:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 74.020865] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 74.023724] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 74.025915] systemd[1]: Starting gitlab.service...1125gitlab # [ 74.392145] bundle[1590]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 74.394210] bundle[1590]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 74.396134] bundle[1590]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 77.079334] sidekiq-cluster[1589]: {"severity":"INFO","time":"2026-09-18T21:03:06.348Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 77.185816] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.453Z","pid":1590,"message":"* Enabling systemd notification integration"}1130gitlab # [ 77.189924] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"Puma starting in cluster mode..."}1131gitlab # [ 77.193617] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 77.197395] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 77.201780] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Min threads: 0"}1134gitlab # [ 77.204975] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Max threads: 4"}1135gitlab # [ 77.208338] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Environment: production"}1136gitlab # [ 77.211555] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Master PID: 1590"}1137gitlab # [ 77.214601] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Workers: 2"}1138gitlab # [ 77.217672] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 77.221473] bundle[1590]: {"timestamp":"2026-09-18T21:03:06.472Z","pid":1590,"message":"* Preloading application"}1140gitlab # [ 78.421909] gitlab-workhorse[823]: time="2026-09-18T21:03:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.431961] gitlab-workhorse[823]: time="2026-09-18T21:03:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.433268] gitlab-workhorse[823]: time="2026-09-18T21:03:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 99.235353] bundle[1590]: W, [2026-09-18T21:03:28.521950 #1590] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 101.974282] sidekiq-cluster[1620]: 2026-09-18T21:03:31.260Z pid=1620 tid=wl8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1620, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>453603328}1145gitlab # [ 102.154388] sidekiq-cluster[1620]: W, [2026-09-18T21:03:31.441219 #1620] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 102.196065] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:31.482Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 104.125083] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.410Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 104.125714] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.411Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 104.150975] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.437Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 104.155364] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.442Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 104.159950] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.446Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 104.164342] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.451Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 104.169060] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.455Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 104.174992] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.461Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 104.180550] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.467Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 104.185525] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.472Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 104.190351] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.477Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 104.195237] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.482Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 104.200331] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.487Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 104.206611] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.493Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 104.211556] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.498Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 104.216683] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.503Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 104.222222] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.509Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 104.227951] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.514Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 104.234476] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.521Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 104.240601] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.527Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 104.246921] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.533Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 104.253102] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.539Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 104.259647] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.546Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 104.264771] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.551Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 104.269670] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.556Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 104.275122] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.561Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 104.280780] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.567Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 104.286922] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.573Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 104.292846] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.579Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 104.298098] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.585Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 104.303585] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.590Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 104.310476] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.597Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 104.315958] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.602Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 104.324208] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.610Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 104.329151] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.616Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 104.333542] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.620Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 104.340664] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.627Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 104.346188] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.633Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 104.351725] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.638Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 104.357293] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.644Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 104.362831] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.649Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 104.368117] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.655Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 104.373839] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.660Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 104.378932] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.665Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 104.384931] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.671Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 104.390609] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.677Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 104.397064] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.683Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 104.402351] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.689Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 104.407340] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.694Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 104.412953] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.699Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 104.418723] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.705Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 104.424337] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.711Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 104.430192] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.717Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 104.436197] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.723Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 104.472235] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.758Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 104.477806] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.764Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 104.482123] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.769Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 104.493763] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.780Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 104.502624] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.789Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 104.513585] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.800Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 104.522660] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.809Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 104.532943] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.819Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 104.541307] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.828Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 104.549426] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.836Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 104.555051] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.841Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 104.565861] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.852Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 104.576234] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.862Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 104.585881] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.872Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 104.595144] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.882Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 104.603333] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.890Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 104.611796] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.898Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 104.621789] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.908Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 104.630782] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.917Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 104.640660] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.927Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 104.648720] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.935Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 104.658447] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.945Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 104.666534] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.953Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 104.674626] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.961Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 104.683313] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.970Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 104.691354] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.978Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 104.699401] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.986Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 104.706529] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:33.993Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 104.714884] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.001Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 104.722569] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.009Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 104.732099] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.018Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 104.737724] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.024Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 104.748161] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.034Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 104.755972] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.042Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 104.765264] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.052Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 104.773650] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.060Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 104.781352] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.068Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 104.785806] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.072Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 104.792932] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.079Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 104.799334] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.086Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 104.804696] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.091Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 104.809874] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.096Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 104.816465] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.103Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 104.822784] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.109Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 104.827904] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.114Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 104.831960] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.118Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 104.852137] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.138Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 104.854819] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.141Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 104.858916] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.145Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 104.861204] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.148Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 104.863299] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.150Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 104.865137] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.152Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 104.867174] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.154Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 104.868545] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.155Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 104.870092] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.157Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 104.872506] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.159Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 104.873651] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:03:34.160Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 108.442797] gitlab-workhorse[823]: time="2026-09-18T21:03:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 118.443979] gitlab-workhorse[823]: time="2026-09-18T21:03:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 128.414522] postgres[2058]: [2058] ERROR: relation "table_without_models" does not exist1261gitlab # [ 128.415166] postgres[2058]: [2058] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1262gitlab # [ 128.447802] gitlab-workhorse[823]: time="2026-09-18T21:03:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 129.459744] postgres[2069]: [2069] ERROR: relation "table_without_models" does not exist1264gitlab # [ 129.460158] postgres[2069]: [2069] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 131.037159] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:00.323Z","message":"Booted Rails 7.2.3.1 application in production environment"}1266gitlab # [ 131.042620] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:00.329Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1267gitlab # [ 131.042804] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:00.329Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1268gitlab # [ 131.043772] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:00.330Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1269gitlab # [ 131.046153] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:00.332Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1270gitlab # [ 132.265561] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.551Z","pid":1590,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1271gitlab # [ 132.266138] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.551Z","pid":1590,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1272gitlab # [ 132.266935] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.551Z","pid":1590,"message":"! #\u003cThread:0x000077dc9b2e1d88 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1273gitlab # [ 132.267815] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.551Z","pid":1590,"message":"! #\u003cThread:0x000077dc9b5e90f8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1274gitlab # [ 132.268673] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.552Z","pid":1590,"message":"Use Ctrl-C to stop"}1275gitlab # [ 132.269544] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.552Z","pid":1590,"message":"Sending status to systemd every 1.0 sec"}1276gitlab # [ 132.337732] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:01.623Z","message":"Cleaning working queues"}1277gitlab # [ 132.338682] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:01.625Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ab608dfd9d1bd4659749900b","created_at":"2026-09-18T21:03:03.019Z","trace_propagation_headers":{"sentry-trace":"3ab8b1825d7b4049b2a4378316c52cd7-3ae8faa47c5648b9","baggage":"sentry-trace_id=3ab8b1825d7b4049b2a4378316c52cd7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e9da6dd55008814db91d33068b7417ef","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T21:03:03.026Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ab608dfd9d1bd4659749900b: start","job_status":"start","queue_duration_s":58.5988,"scheduling_latency_s":58.598855}1278gitlab # [ 132.475642] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:01.762Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ab608dfd9d1bd4659749900b","created_at":"2026-09-18T21:03:03.019Z","trace_propagation_headers":{"sentry-trace":"3ab8b1825d7b4049b2a4378316c52cd7-3ae8faa47c5648b9","baggage":"sentry-trace_id=3ab8b1825d7b4049b2a4378316c52cd7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e9da6dd55008814db91d33068b7417ef","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T21:03:03.026Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ab608dfd9d1bd4659749900b: done: 0.136842 sec","job_status":"done","queue_duration_s":58.5988,"scheduling_latency_s":58.598855,"redis_calls":24,"redis_duration_s":0.007953,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005048,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0646043,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.136842,"completed_at":"2026-09-18T21:04:01.762Z","load_balancing_strategy":"primary","db_duration_s":0.033997,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1279gitlab # [ 132.670504] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.957Z","pid":1590,"message":"- Worker 0 (PID: 2167) booted in 0.34s, phase: 0"}1280gitlab # [ 132.681228] bundle[1590]: {"timestamp":"2026-09-18T21:04:01.967Z","pid":1590,"message":"- Worker 1 (PID: 2172) booted in 0.34s, phase: 0"}1281gitlab # [ 132.687576] systemd[1]: Started gitlab.service.1282gitlab # [ 132.688447] systemd[1]: Reached target Common target for all GitLab services..1283gitlab # [ 132.691166] systemd[1]: Starting setup-gitlab.service...1284gitlab # [ 132.707801] setup-gitlab-start[2199]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1285gitlab # [ 134.978301] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:04:04 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22381286gitlab # [ 134.985613] setup-gitlab-start[2199]: + TOKEN=nixbot-test-token-of-20-chars1287gitlab # [ 134.986356] setup-gitlab-start[2199]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1288gitlab # [ 135.008257] runuser[2217]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1289gitlab # [ 135.359992] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 135.360435] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 135.362085] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 135.935832] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 135.936856] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 135.938247] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 142.747584] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ebf51b9b0bfd40b96ab3b97f","created_at":"2026-09-18T21:04:11.999Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31683de944e4ca254e5fde8c18def931","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.030Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ebf51b9b0bfd40b96ab3b97f: start","job_status":"start","queue_duration_s":0.002936,"scheduling_latency_s":0.002989}1296gitlab # [ 142.792938] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.079Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1297gitlab # [ 142.811946] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ebf51b9b0bfd40b96ab3b97f","created_at":"2026-09-18T21:04:11.999Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31683de944e4ca254e5fde8c18def931","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.030Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ebf51b9b0bfd40b96ab3b97f: done: 0.065366 sec","job_status":"done","queue_duration_s":0.002936,"scheduling_latency_s":0.002989,"redis_calls":10,"redis_duration_s":0.013771,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00146,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001830959,"duration_s":0.065366,"completed_at":"2026-09-18T21:04:12.098Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 142.875984] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4112776e96869c95a0f6d5c5","created_at":"2026-09-18T21:04:12.042Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"750e55fc7047c19fa2f32b15ea410b8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.056Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4112776e96869c95a0f6d5c5: start","job_status":"start","queue_duration_s":0.106271,"scheduling_latency_s":0.106315}1299gitlab # [ 142.955858] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4112776e96869c95a0f6d5c5","created_at":"2026-09-18T21:04:12.042Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"750e55fc7047c19fa2f32b15ea410b8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.056Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4112776e96869c95a0f6d5c5: done: 0.079608 sec","job_status":"done","queue_duration_s":0.106271,"scheduling_latency_s":0.106315,"redis_calls":12,"redis_duration_s":0.030937,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004056,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.025527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001354,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000861004,"duration_s":0.079608,"completed_at":"2026-09-18T21:04:12.241Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 142.999071] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"37d4d53b75498cc47088bdf2","created_at":"2026-09-18T21:04:12.078Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b09be1e4478285fa185448bf5904f0df","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.161Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-37d4d53b75498cc47088bdf2: start","job_status":"start","queue_duration_s":0.086811,"scheduling_latency_s":0.086854}1301gitlab # [ 143.071316] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"37d4d53b75498cc47088bdf2","created_at":"2026-09-18T21:04:12.078Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b09be1e4478285fa185448bf5904f0df","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.161Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-37d4d53b75498cc47088bdf2: done: 0.109787 sec","job_status":"done","queue_duration_s":0.086811,"scheduling_latency_s":0.086854,"redis_calls":10,"redis_duration_s":0.02922,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002815,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.018164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002528254,"duration_s":0.109787,"completed_at":"2026-09-18T21:04:12.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 143.112408] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f93ffd78e3e1e341a8c5a61b","created_at":"2026-09-18T21:04:12.206Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61991ba57cc2797a7af90a2e41a9dae6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.227Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f93ffd78e3e1e341a8c5a61b: start","job_status":"start","queue_duration_s":0.139197,"scheduling_latency_s":0.13924}1303gitlab # [ 143.193160] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f93ffd78e3e1e341a8c5a61b","created_at":"2026-09-18T21:04:12.206Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61991ba57cc2797a7af90a2e41a9dae6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.227Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f93ffd78e3e1e341a8c5a61b: done: 0.112426 sec","job_status":"done","queue_duration_s":0.139197,"scheduling_latency_s":0.13924,"redis_calls":12,"redis_duration_s":0.031015,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.013932,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001413028,"exclusive_lock_hold_duration_s":0.039347458999999994,"duration_s":0.112426,"completed_at":"2026-09-18T21:04:12.478Z","load_balancing_strategy":"primary","db_duration_s":0.034703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 143.247271] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"66f39123bcc947fb7d301a8d","created_at":"2026-09-18T21:04:12.243Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.255Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-66f39123bcc947fb7d301a8d: start","job_status":"start","queue_duration_s":0.278725,"scheduling_latency_s":0.278769}1305gitlab # [ 143.387538] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"66f39123bcc947fb7d301a8d","created_at":"2026-09-18T21:04:12.243Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.255Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-66f39123bcc947fb7d301a8d: done: 0.140077 sec","job_status":"done","queue_duration_s":0.278725,"scheduling_latency_s":0.278769,"redis_calls":19,"redis_duration_s":0.021549,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00585,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001501,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.011221,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002977,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077859,"duration_s":0.140077,"completed_at":"2026-09-18T21:04:12.673Z","load_balancing_strategy":"primary","db_duration_s":0.009337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 143.457267] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dc5297bbfa848c0cbe5e8abe","created_at":"2026-09-18T21:04:12.272Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c545ac91a48642c668731b6ecbf8b5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.318Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dc5297bbfa848c0cbe5e8abe: start","job_status":"start","queue_duration_s":0.36198,"scheduling_latency_s":0.362016}1307gitlab # [ 143.510463] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dc5297bbfa848c0cbe5e8abe","created_at":"2026-09-18T21:04:12.272Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c545ac91a48642c668731b6ecbf8b5f2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.318Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dc5297bbfa848c0cbe5e8abe: done: 0.115818 sec","job_status":"done","queue_duration_s":0.36198,"scheduling_latency_s":0.362016,"redis_calls":16,"redis_duration_s":0.011073,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.009314,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023327,"duration_s":0.115818,"completed_at":"2026-09-18T21:04:12.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 143.511866] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d5742e6842711d76ab47c73b","created_at":"2026-09-18T21:04:12.345Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8cc84a371178e1d97896e6ad9374d28","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.362Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d5742e6842711d76ab47c73b: start","job_status":"start","queue_duration_s":0.436072,"scheduling_latency_s":0.436087}1309gitlab # [ 143.654243] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d5742e6842711d76ab47c73b","created_at":"2026-09-18T21:04:12.345Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8cc84a371178e1d97896e6ad9374d28","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.362Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d5742e6842711d76ab47c73b: done: 0.141708 sec","job_status":"done","queue_duration_s":0.436072,"scheduling_latency_s":0.436087,"redis_calls":12,"redis_duration_s":0.007963,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000424,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004879,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.074,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00086268,"exclusive_lock_hold_duration_s":0.051655728000000005,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.141708,"completed_at":"2026-09-18T21:04:12.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 143.705489] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:12.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"00f78f3587f965a758b8dd9b","created_at":"2026-09-18T21:04:12.370Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbd4fd923fc5fbcb8acf2e5b82b2c92f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.394Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-00f78f3587f965a758b8dd9b: start","job_status":"start","queue_duration_s":0.597368,"scheduling_latency_s":0.597415}1311gitlab # [ 143.770451] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.056Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1312gitlab # [ 143.791890] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"00f78f3587f965a758b8dd9b","created_at":"2026-09-18T21:04:12.370Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbd4fd923fc5fbcb8acf2e5b82b2c92f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.394Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-00f78f3587f965a758b8dd9b: done: 0.085451 sec","job_status":"done","queue_duration_s":0.597368,"scheduling_latency_s":0.597415,"redis_calls":10,"redis_duration_s":0.011041,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003043,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000949841,"duration_s":0.085451,"completed_at":"2026-09-18T21:04:13.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 143.838690] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fcccd545180b04b030db1ed7","created_at":"2026-09-18T21:04:12.440Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce05da6facd65cda76397d118434d4fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T21:04:12.452Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fcccd545180b04b030db1ed7: start","job_status":"start","queue_duration_s":0.63958,"scheduling_latency_s":0.639628}1314gitlab # [ 143.839561] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.117Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1315gitlab # [ 143.844386] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fcccd545180b04b030db1ed7","created_at":"2026-09-18T21:04:12.440Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce05da6facd65cda76397d118434d4fd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-18T21:04:12.452Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fcccd545180b04b030db1ed7: done: 0.038901 sec","job_status":"done","queue_duration_s":0.63958,"scheduling_latency_s":0.639628,"redis_calls":10,"redis_duration_s":0.0033550000000000003,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000891454,"duration_s":0.038901,"completed_at":"2026-09-18T21:04:13.130Z","load_balancing_strategy":"primary","db_duration_s":0.005277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 143.851935] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7e905547a7956c0a98487f96","created_at":"2026-09-18T21:04:12.473Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a5d7e5c55f5961cb4e41d50fae590ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T21:04:12.532Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7e905547a7956c0a98487f96: start","job_status":"start","queue_duration_s":0.600022,"scheduling_latency_s":0.600049}1317gitlab # [ 143.888710] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7e905547a7956c0a98487f96","created_at":"2026-09-18T21:04:12.473Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a5d7e5c55f5961cb4e41d50fae590ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-18T21:04:12.532Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7e905547a7956c0a98487f96: done: 0.042495 sec","job_status":"done","queue_duration_s":0.600022,"scheduling_latency_s":0.600049,"redis_calls":10,"redis_duration_s":0.002327,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000417651,"duration_s":0.042495,"completed_at":"2026-09-18T21:04:13.175Z","load_balancing_strategy":"primary","db_duration_s":0.007141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 143.901081] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"17dfc8ed024d24f8ed9e8612","created_at":"2026-09-18T21:04:12.540Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27a3af15f102912a6757baa5f43b5af8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T21:04:12.557Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-17dfc8ed024d24f8ed9e8612: start","job_status":"start","queue_duration_s":0.619267,"scheduling_latency_s":0.619281}1319gitlab # [ 143.913607] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.185Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1320gitlab # [ 143.953764] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"17dfc8ed024d24f8ed9e8612","created_at":"2026-09-18T21:04:12.540Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27a3af15f102912a6757baa5f43b5af8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-18T21:04:12.557Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-17dfc8ed024d24f8ed9e8612: done: 0.014646 sec","job_status":"done","queue_duration_s":0.619267,"scheduling_latency_s":0.619281,"redis_calls":10,"redis_duration_s":0.001301,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206172,"duration_s":0.014646,"completed_at":"2026-09-18T21:04:13.191Z","load_balancing_strategy":"primary","db_duration_s":0.001819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 143.954790] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.192Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2d83645cca545aafcfc5a53d","created_at":"2026-09-18T21:04:12.573Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78c0bc4091169f756e9292e01d5c8bf6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.587Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2d83645cca545aafcfc5a53d: start","job_status":"start","queue_duration_s":0.605014,"scheduling_latency_s":0.605026}1322gitlab # [ 143.965679] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.205Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2d83645cca545aafcfc5a53d","created_at":"2026-09-18T21:04:12.573Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78c0bc4091169f756e9292e01d5c8bf6","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.587Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2d83645cca545aafcfc5a53d: done: 0.013367 sec","job_status":"done","queue_duration_s":0.605014,"scheduling_latency_s":0.605026,"redis_calls":12,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000312,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204216,"duration_s":0.013367,"completed_at":"2026-09-18T21:04:13.205Z","load_balancing_strategy":"primary","db_duration_s":0.001068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 144.036755] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.206Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ea5346c86458d0a207ef1712","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ea5346c86458d0a207ef1712: start","job_status":"start","queue_duration_s":0.56258,"scheduling_latency_s":0.562594}1324gitlab # [ 144.037533] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.216Z","message":"No existing merge request to be cleaned up."}1325gitlab # [ 144.038062] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.224Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ea5346c86458d0a207ef1712","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ea5346c86458d0a207ef1712: done: 0.018457 sec","job_status":"done","queue_duration_s":0.56258,"scheduling_latency_s":0.562594,"redis_calls":13,"redis_duration_s":0.001892,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202819,"duration_s":0.018457,"completed_at":"2026-09-18T21:04:13.224Z","load_balancing_strategy":"primary","db_duration_s":0.002235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 144.078666] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.225Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"acdd1c3acfb8d6868d3766aa","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-acdd1c3acfb8d6868d3766aa: start","job_status":"start","queue_duration_s":0.581879,"scheduling_latency_s":0.581892}1327gitlab # [ 144.079432] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.232Z","message":"No existing merge request to be cleaned up."}1328gitlab # [ 144.079962] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.237Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"acdd1c3acfb8d6868d3766aa","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-acdd1c3acfb8d6868d3766aa: done: 0.011257 sec","job_status":"done","queue_duration_s":0.581879,"scheduling_latency_s":0.581892,"redis_calls":10,"redis_duration_s":0.001422,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011257,"completed_at":"2026-09-18T21:04:13.237Z","load_balancing_strategy":"primary","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 144.124209] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.238Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fe4ea3bb7d4e91b1a7173e9f","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fe4ea3bb7d4e91b1a7173e9f: start","job_status":"start","queue_duration_s":0.594094,"scheduling_latency_s":0.594107}1330gitlab # [ 144.124880] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.247Z","message":"No existing merge request to be cleaned up."}1331gitlab # [ 144.125585] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.251Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fe4ea3bb7d4e91b1a7173e9f","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fe4ea3bb7d4e91b1a7173e9f: done: 0.013817 sec","job_status":"done","queue_duration_s":0.594094,"scheduling_latency_s":0.594107,"redis_calls":10,"redis_duration_s":0.001371,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013817,"completed_at":"2026-09-18T21:04:13.251Z","load_balancing_strategy":"primary","db_duration_s":0.005108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 144.172667] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.252Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1e3a22625f1a58e1a9b4f802","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1e3a22625f1a58e1a9b4f802: start","job_status":"start","queue_duration_s":0.60904,"scheduling_latency_s":0.609053}1333gitlab # [ 144.173578] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.261Z","message":"No existing merge request to be cleaned up."}1334gitlab # [ 144.174110] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.266Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1e3a22625f1a58e1a9b4f802","created_at":"2026-09-18T21:04:12.580Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-69c7004b731c4c76","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5e0c5a8b7b26ebf5b3ab0447572b9bea","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.643Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1e3a22625f1a58e1a9b4f802: done: 0.013142 sec","job_status":"done","queue_duration_s":0.60904,"scheduling_latency_s":0.609053,"redis_calls":10,"redis_duration_s":0.001252,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013142,"completed_at":"2026-09-18T21:04:13.266Z","load_balancing_strategy":"primary","db_duration_s":0.003645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 144.221791] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"16c3063b4f5201375f272f7c","created_at":"2026-09-18T21:04:12.634Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6702d187d5c9e92c7dbc5ede0b577c8c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.648Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-16c3063b4f5201375f272f7c: start","job_status":"start","queue_duration_s":0.618295,"scheduling_latency_s":0.618309}1336gitlab # [ 144.222768] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"16c3063b4f5201375f272f7c","created_at":"2026-09-18T21:04:12.634Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6702d187d5c9e92c7dbc5ede0b577c8c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.648Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-16c3063b4f5201375f272f7c: done: 0.229924 sec","job_status":"done","queue_duration_s":0.618295,"scheduling_latency_s":0.618309,"redis_calls":565,"redis_duration_s":0.065085,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.063986,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.186796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255619,"duration_s":0.229924,"completed_at":"2026-09-18T21:04:13.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 144.265326] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e948a38540d3ed1e0f1c4e23","created_at":"2026-09-18T21:04:12.671Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f57a13c41e9ad9d3c9d725ca763062c8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.725Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e948a38540d3ed1e0f1c4e23: start","job_status":"start","queue_duration_s":0.772988,"scheduling_latency_s":0.773002}1338gitlab # [ 144.265963] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e948a38540d3ed1e0f1c4e23","created_at":"2026-09-18T21:04:12.671Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f57a13c41e9ad9d3c9d725ca763062c8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.725Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e948a38540d3ed1e0f1c4e23: done: 0.023478 sec","job_status":"done","queue_duration_s":0.772988,"scheduling_latency_s":0.773002,"redis_calls":10,"redis_duration_s":0.001396,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021148,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.023478,"completed_at":"2026-09-18T21:04:13.521Z","load_balancing_strategy":"primary","db_duration_s":0.008079,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 144.309028] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ec14b21c11355c4a52015c25","created_at":"2026-09-18T21:04:12.748Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3960610176c894a55db87a8441203b55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.766Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ec14b21c11355c4a52015c25: start","job_status":"start","queue_duration_s":0.755983,"scheduling_latency_s":0.755996}1340gitlab # [ 144.309757] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ec14b21c11355c4a52015c25","created_at":"2026-09-18T21:04:12.748Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3960610176c894a55db87a8441203b55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.766Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ec14b21c11355c4a52015c25: done: 0.012299 sec","job_status":"done","queue_duration_s":0.755983,"scheduling_latency_s":0.755996,"redis_calls":10,"redis_duration_s":0.001325,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198349,"duration_s":0.012299,"completed_at":"2026-09-18T21:04:13.534Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 144.360140] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1bb552748370d3ede94a4b43","created_at":"2026-09-18T21:04:12.772Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.781Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1bb552748370d3ede94a4b43: start","job_status":"start","queue_duration_s":0.754423,"scheduling_latency_s":0.754435}1342gitlab # [ 144.360835] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1bb552748370d3ede94a4b43","created_at":"2026-09-18T21:04:12.772Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.781Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1bb552748370d3ede94a4b43: done: 0.067689 sec","job_status":"done","queue_duration_s":0.754423,"scheduling_latency_s":0.754435,"redis_calls":71,"redis_duration_s":0.009962,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001232,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000602,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007741,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218464,"duration_s":0.067689,"completed_at":"2026-09-18T21:04:13.603Z","load_balancing_strategy":"primary","db_duration_s":0.00103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 144.429631] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f67008ccd376a097a016e03f","created_at":"2026-09-18T21:04:12.788Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"530f758962d4d481ce8142261c28a605","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.851Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f67008ccd376a097a016e03f: start","job_status":"start","queue_duration_s":0.753295,"scheduling_latency_s":0.753309}1344gitlab # [ 144.430586] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f67008ccd376a097a016e03f","created_at":"2026-09-18T21:04:12.788Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"530f758962d4d481ce8142261c28a605","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.851Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f67008ccd376a097a016e03f: done: 0.0202 sec","job_status":"done","queue_duration_s":0.753295,"scheduling_latency_s":0.753309,"redis_calls":13,"redis_duration_s":0.001896,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006232356,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.0202,"completed_at":"2026-09-18T21:04:13.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001912,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1345gitlab # [ 144.481535] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"52c54ef8a9601395cbe0a243","created_at":"2026-09-18T21:04:12.865Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"063ec4f00506f4cdafba3eccc7c3916b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.868Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-52c54ef8a9601395cbe0a243: start","job_status":"start","queue_duration_s":0.757289,"scheduling_latency_s":0.757303}1346gitlab # [ 144.482231] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.632Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1347gitlab # [ 144.482757] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"52c54ef8a9601395cbe0a243","created_at":"2026-09-18T21:04:12.865Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"063ec4f00506f4cdafba3eccc7c3916b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.868Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-52c54ef8a9601395cbe0a243: done: 0.011965 sec","job_status":"done","queue_duration_s":0.757289,"scheduling_latency_s":0.757303,"redis_calls":10,"redis_duration_s":0.001268,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201701,"duration_s":0.011965,"completed_at":"2026-09-18T21:04:13.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 144.531194] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e8e70adf5ef078981f65df51","created_at":"2026-09-18T21:04:12.883Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"926f8d1327cab778823ca3d5099804c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.888Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e8e70adf5ef078981f65df51: start","job_status":"start","queue_duration_s":0.750431,"scheduling_latency_s":0.750444}1349gitlab # [ 144.531921] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e8e70adf5ef078981f65df51","created_at":"2026-09-18T21:04:12.883Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"926f8d1327cab778823ca3d5099804c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.888Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e8e70adf5ef078981f65df51: done: 0.119548 sec","job_status":"done","queue_duration_s":0.750431,"scheduling_latency_s":0.750444,"redis_calls":14,"redis_duration_s":0.002043,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000366806,"exclusive_lock_hold_duration_s":0.103883315,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.119548,"completed_at":"2026-09-18T21:04:13.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 144.586858] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a92151a10655f79d17a75ccc","created_at":"2026-09-18T21:04:12.892Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbebaa5b3b12eabbe9062c6c98eeb8aa","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.898Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a92151a10655f79d17a75ccc: start","job_status":"start","queue_duration_s":0.860943,"scheduling_latency_s":0.860957}1351gitlab # [ 144.587729] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a92151a10655f79d17a75ccc","created_at":"2026-09-18T21:04:12.892Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbebaa5b3b12eabbe9062c6c98eeb8aa","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.898Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a92151a10655f79d17a75ccc: done: 0.016064 sec","job_status":"done","queue_duration_s":0.860943,"scheduling_latency_s":0.860957,"redis_calls":10,"redis_duration_s":0.00145,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229639,"duration_s":0.016064,"completed_at":"2026-09-18T21:04:13.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 144.604673] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.776Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c440037c13c06ad8681f42cc","created_at":"2026-09-18T21:04:12.912Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba754a5bfbbd6c5ce1bfd8477ea77abc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.919Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c440037c13c06ad8681f42cc: start","job_status":"start","queue_duration_s":0.856722,"scheduling_latency_s":0.856735}1353gitlab # [ 144.647737] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c440037c13c06ad8681f42cc","created_at":"2026-09-18T21:04:12.912Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba754a5bfbbd6c5ce1bfd8477ea77abc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.919Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c440037c13c06ad8681f42cc: done: 0.014963 sec","job_status":"done","queue_duration_s":0.856722,"scheduling_latency_s":0.856735,"redis_calls":12,"redis_duration_s":0.001618,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000334121,"exclusive_lock_hold_duration_s":0.0027497909999999997,"duration_s":0.014963,"completed_at":"2026-09-18T21:04:13.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 144.693796] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.792Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"32ca9e5a54622d26a6f5427c","created_at":"2026-09-18T21:04:12.928Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"fa103427b0e4dc224ff2333a472fbb44","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.941Z","job_size_bytes":3,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-32ca9e5a54622d26a6f5427c: start","job_status":"start","queue_duration_s":0.850868,"scheduling_latency_s":0.850882}1355gitlab # [ 144.694686] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.854Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"32ca9e5a54622d26a6f5427c","created_at":"2026-09-18T21:04:12.928Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"fa103427b0e4dc224ff2333a472fbb44","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:12.941Z","job_size_bytes":3,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-32ca9e5a54622d26a6f5427c: done: 0.061346 sec","job_status":"done","queue_duration_s":0.850868,"scheduling_latency_s":0.850882,"redis_calls":10,"redis_duration_s":0.001534,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024221,"duration_s":0.061346,"completed_at":"2026-09-18T21:04:13.853Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 144.705814] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ce46479aecfab398efc59c2a","created_at":"2026-09-18T21:04:13.006Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7ea28ea44dfc331e5799f39ec808ea8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.018Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ce46479aecfab398efc59c2a: start","job_status":"start","queue_duration_s":0.836518,"scheduling_latency_s":0.836533}1357gitlab # [ 144.718848] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ce46479aecfab398efc59c2a","created_at":"2026-09-18T21:04:13.006Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7ea28ea44dfc331e5799f39ec808ea8","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.018Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ce46479aecfab398efc59c2a: done: 0.014438 sec","job_status":"done","queue_duration_s":0.836518,"scheduling_latency_s":0.836533,"redis_calls":12,"redis_duration_s":0.001656,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000616,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000319873,"exclusive_lock_hold_duration_s":0.00210781,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.014438,"completed_at":"2026-09-18T21:04:13.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 144.777500] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"18f0b10bb3bc8f6cc3e51c09","created_at":"2026-09-18T21:04:13.049Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a10f65d7e4c91fab5e51e7d86b261193","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.066Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-18f0b10bb3bc8f6cc3e51c09: start","job_status":"start","queue_duration_s":0.804044,"scheduling_latency_s":0.804057}1359gitlab # [ 144.778392] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"18f0b10bb3bc8f6cc3e51c09","created_at":"2026-09-18T21:04:13.049Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a10f65d7e4c91fab5e51e7d86b261193","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.066Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-18f0b10bb3bc8f6cc3e51c09: done: 0.123814 sec","job_status":"done","queue_duration_s":0.804044,"scheduling_latency_s":0.804057,"redis_calls":14,"redis_duration_s":0.002108,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000320432,"exclusive_lock_hold_duration_s":0.109644103,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.123814,"completed_at":"2026-09-18T21:04:13.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 144.811082] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:13.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"41850cf7600797b5c1eaeba1","created_at":"2026-09-18T21:04:13.086Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e672ab4a3e46edd9047a5a160f4f86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.112Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-41850cf7600797b5c1eaeba1: start","job_status":"start","queue_duration_s":0.88339,"scheduling_latency_s":0.883403}1361gitlab # [ 144.859784] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.003Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1362gitlab # [ 144.860621] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"41850cf7600797b5c1eaeba1","created_at":"2026-09-18T21:04:13.086Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-23afe79a9e464501","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e672ab4a3e46edd9047a5a160f4f86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.112Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-41850cf7600797b5c1eaeba1: done: 0.012324 sec","job_status":"done","queue_duration_s":0.88339,"scheduling_latency_s":0.883403,"redis_calls":10,"redis_duration_s":0.001267,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230476,"duration_s":0.012324,"completed_at":"2026-09-18T21:04:14.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 144.866281] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0b6116845124c60702435dd","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0b6116845124c60702435dd: start","job_status":"start","queue_duration_s":0.412141,"scheduling_latency_s":0.412154}1364gitlab # [ 144.877787] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0b6116845124c60702435dd","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0b6116845124c60702435dd: done: 0.013432 sec","job_status":"done","queue_duration_s":0.412141,"scheduling_latency_s":0.412154,"redis_calls":16,"redis_duration_s":0.001993,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203377,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013432,"completed_at":"2026-09-18T21:04:14.022Z","load_balancing_strategy":"primary","db_duration_s":0.000224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 144.918944] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91b300f1260feb17fe99f4be","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91b300f1260feb17fe99f4be: start","job_status":"start","queue_duration_s":0.426417,"scheduling_latency_s":0.42643}1366gitlab # [ 144.925325] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91b300f1260feb17fe99f4be","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91b300f1260feb17fe99f4be: done: 0.009413 sec","job_status":"done","queue_duration_s":0.426417,"scheduling_latency_s":0.42643,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009413,"completed_at":"2026-09-18T21:04:14.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 144.970982] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6aed28facec292be828b6c3","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6aed28facec292be828b6c3: start","job_status":"start","queue_duration_s":0.436664,"scheduling_latency_s":0.436677}1368gitlab # [ 144.972129] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6aed28facec292be828b6c3","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6aed28facec292be828b6c3: done: 0.009207 sec","job_status":"done","queue_duration_s":0.436664,"scheduling_latency_s":0.436677,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009207,"completed_at":"2026-09-18T21:04:14.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 145.023790] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee5aa6c3d1bc1a33adbc2223","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee5aa6c3d1bc1a33adbc2223: start","job_status":"start","queue_duration_s":0.446709,"scheduling_latency_s":0.446722}1370gitlab # [ 145.024626] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee5aa6c3d1bc1a33adbc2223","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee5aa6c3d1bc1a33adbc2223: done: 0.009228 sec","job_status":"done","queue_duration_s":0.446709,"scheduling_latency_s":0.446722,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009228,"completed_at":"2026-09-18T21:04:14.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 145.082634] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6682b76dd25ec6e219dcf8f2","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6682b76dd25ec6e219dcf8f2: start","job_status":"start","queue_duration_s":0.456768,"scheduling_latency_s":0.456781}1372gitlab # [ 145.083594] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6682b76dd25ec6e219dcf8f2","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6682b76dd25ec6e219dcf8f2: done: 0.009428 sec","job_status":"done","queue_duration_s":0.456768,"scheduling_latency_s":0.456781,"redis_calls":13,"redis_duration_s":0.0015309999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009428,"completed_at":"2026-09-18T21:04:14.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 145.123595] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afc44f97902d5abde3065fb7","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afc44f97902d5abde3065fb7: start","job_status":"start","queue_duration_s":0.467005,"scheduling_latency_s":0.467019}1374gitlab # [ 145.124532] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afc44f97902d5abde3065fb7","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afc44f97902d5abde3065fb7: done: 0.00916 sec","job_status":"done","queue_duration_s":0.467005,"scheduling_latency_s":0.467019,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00916,"completed_at":"2026-09-18T21:04:14.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 145.170371] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4993d5ca14a51b21a1333d93","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4993d5ca14a51b21a1333d93: start","job_status":"start","queue_duration_s":0.477055,"scheduling_latency_s":0.477068}1376gitlab # [ 145.171090] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4993d5ca14a51b21a1333d93","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4993d5ca14a51b21a1333d93: done: 0.009159 sec","job_status":"done","queue_duration_s":0.477055,"scheduling_latency_s":0.477068,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009159,"completed_at":"2026-09-18T21:04:14.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 145.191819] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d82f742595f73d07ddd12be","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d82f742595f73d07ddd12be: start","job_status":"start","queue_duration_s":0.487016,"scheduling_latency_s":0.48703}1378gitlab # [ 145.203256] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d82f742595f73d07ddd12be","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d82f742595f73d07ddd12be: done: 0.009017 sec","job_status":"done","queue_duration_s":0.487016,"scheduling_latency_s":0.48703,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009017,"completed_at":"2026-09-18T21:04:14.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 145.244790] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33a29d334c3bbbe47a750256","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33a29d334c3bbbe47a750256: start","job_status":"start","queue_duration_s":0.497218,"scheduling_latency_s":0.497231}1380gitlab # [ 145.248902] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33a29d334c3bbbe47a750256","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33a29d334c3bbbe47a750256: done: 0.009493 sec","job_status":"done","queue_duration_s":0.497218,"scheduling_latency_s":0.497231,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009493,"completed_at":"2026-09-18T21:04:14.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 145.305640] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a053c9d66048130b03445449","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a053c9d66048130b03445449: start","job_status":"start","queue_duration_s":0.507541,"scheduling_latency_s":0.507553}1382gitlab # [ 145.306580] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a053c9d66048130b03445449","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a053c9d66048130b03445449: done: 0.009397 sec","job_status":"done","queue_duration_s":0.507541,"scheduling_latency_s":0.507553,"redis_calls":13,"redis_duration_s":0.0015459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009397,"completed_at":"2026-09-18T21:04:14.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 145.348728] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84156348029c5dc93ec8d7b8","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84156348029c5dc93ec8d7b8: start","job_status":"start","queue_duration_s":0.517759,"scheduling_latency_s":0.517771}1384gitlab # [ 145.349565] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84156348029c5dc93ec8d7b8","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84156348029c5dc93ec8d7b8: done: 0.009693 sec","job_status":"done","queue_duration_s":0.517759,"scheduling_latency_s":0.517771,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009693,"completed_at":"2026-09-18T21:04:14.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 145.410749] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dee398e7e8efb0c7239379e6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dee398e7e8efb0c7239379e6: start","job_status":"start","queue_duration_s":0.528286,"scheduling_latency_s":0.5283}1386gitlab # [ 145.411492] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dee398e7e8efb0c7239379e6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dee398e7e8efb0c7239379e6: done: 0.010183 sec","job_status":"done","queue_duration_s":0.528286,"scheduling_latency_s":0.5283,"redis_calls":13,"redis_duration_s":0.001615,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010183,"completed_at":"2026-09-18T21:04:14.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 145.453404] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c669eaa4578d856b3ce4f61","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c669eaa4578d856b3ce4f61: start","job_status":"start","queue_duration_s":0.539293,"scheduling_latency_s":0.539305}1388gitlab # [ 145.454101] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c669eaa4578d856b3ce4f61","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c669eaa4578d856b3ce4f61: done: 0.009523 sec","job_status":"done","queue_duration_s":0.539293,"scheduling_latency_s":0.539305,"redis_calls":13,"redis_duration_s":0.0015730000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009523,"completed_at":"2026-09-18T21:04:14.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 145.467944] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45fe2b0c4c4c07b7639041cb","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45fe2b0c4c4c07b7639041cb: start","job_status":"start","queue_duration_s":0.549782,"scheduling_latency_s":0.549796}1390gitlab # [ 145.511461] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45fe2b0c4c4c07b7639041cb","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45fe2b0c4c4c07b7639041cb: done: 0.00942 sec","job_status":"done","queue_duration_s":0.549782,"scheduling_latency_s":0.549796,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00942,"completed_at":"2026-09-18T21:04:14.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 145.514744] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69b0aff527ca5f4409a562c5","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69b0aff527ca5f4409a562c5: start","job_status":"start","queue_duration_s":0.559999,"scheduling_latency_s":0.560011}1392gitlab # [ 145.525865] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69b0aff527ca5f4409a562c5","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69b0aff527ca5f4409a562c5: done: 0.009044 sec","job_status":"done","queue_duration_s":0.559999,"scheduling_latency_s":0.560011,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009044,"completed_at":"2026-09-18T21:04:14.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 145.582731] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b42f63ef455e565939277ff","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b42f63ef455e565939277ff: start","job_status":"start","queue_duration_s":0.570273,"scheduling_latency_s":0.570285}1394gitlab # [ 145.583555] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b42f63ef455e565939277ff","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b42f63ef455e565939277ff: done: 0.009147 sec","job_status":"done","queue_duration_s":0.570273,"scheduling_latency_s":0.570285,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009147,"completed_at":"2026-09-18T21:04:14.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 145.622943] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e340748c9b07383f65b06201","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e340748c9b07383f65b06201: start","job_status":"start","queue_duration_s":0.580281,"scheduling_latency_s":0.580294}1396gitlab # [ 145.623783] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e340748c9b07383f65b06201","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e340748c9b07383f65b06201: done: 0.009063 sec","job_status":"done","queue_duration_s":0.580281,"scheduling_latency_s":0.580294,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009063,"completed_at":"2026-09-18T21:04:14.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 145.662728] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5615efc7e24916a6de09e59","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5615efc7e24916a6de09e59: start","job_status":"start","queue_duration_s":0.590175,"scheduling_latency_s":0.590187}1398gitlab # [ 145.664682] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5615efc7e24916a6de09e59","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5615efc7e24916a6de09e59: done: 0.00917 sec","job_status":"done","queue_duration_s":0.590175,"scheduling_latency_s":0.590187,"redis_calls":13,"redis_duration_s":0.0015919999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00917,"completed_at":"2026-09-18T21:04:14.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 145.715721] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a39f6842bca9ee110000fea","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a39f6842bca9ee110000fea: start","job_status":"start","queue_duration_s":0.600364,"scheduling_latency_s":0.600377}1400gitlab # [ 145.716623] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a39f6842bca9ee110000fea","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a39f6842bca9ee110000fea: done: 0.009084 sec","job_status":"done","queue_duration_s":0.600364,"scheduling_latency_s":0.600377,"redis_calls":13,"redis_duration_s":0.0016160000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009084,"completed_at":"2026-09-18T21:04:14.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 145.756034] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24fd8876e145eaa12dbff4f6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24fd8876e145eaa12dbff4f6: start","job_status":"start","queue_duration_s":0.610406,"scheduling_latency_s":0.610418}1402gitlab # [ 145.756766] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24fd8876e145eaa12dbff4f6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24fd8876e145eaa12dbff4f6: done: 0.009046 sec","job_status":"done","queue_duration_s":0.610406,"scheduling_latency_s":0.610418,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009046,"completed_at":"2026-09-18T21:04:14.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 145.792085] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a40ebdaa7dac6cb83b284979","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a40ebdaa7dac6cb83b284979: start","job_status":"start","queue_duration_s":0.620351,"scheduling_latency_s":0.620365}1404gitlab # [ 145.836713] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a40ebdaa7dac6cb83b284979","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a40ebdaa7dac6cb83b284979: done: 0.009153 sec","job_status":"done","queue_duration_s":0.620351,"scheduling_latency_s":0.620365,"redis_calls":13,"redis_duration_s":0.001726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009153,"completed_at":"2026-09-18T21:04:14.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 145.837713] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d09f3937648034e7c7a9f54d","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d09f3937648034e7c7a9f54d: start","job_status":"start","queue_duration_s":0.630391,"scheduling_latency_s":0.630404}1406gitlab # [ 145.848943] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d09f3937648034e7c7a9f54d","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d09f3937648034e7c7a9f54d: done: 0.009016 sec","job_status":"done","queue_duration_s":0.630391,"scheduling_latency_s":0.630404,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009016,"completed_at":"2026-09-18T21:04:14.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 145.918817] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8463c000ec662f11d68dfb7","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8463c000ec662f11d68dfb7: start","job_status":"start","queue_duration_s":0.64028,"scheduling_latency_s":0.640292}1408gitlab # [ 145.919764] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8463c000ec662f11d68dfb7","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8463c000ec662f11d68dfb7: done: 0.009018 sec","job_status":"done","queue_duration_s":0.64028,"scheduling_latency_s":0.640292,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009018,"completed_at":"2026-09-18T21:04:14.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 145.930286] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c1bd6938333bfd82810794a","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c1bd6938333bfd82810794a: start","job_status":"start","queue_duration_s":0.650281,"scheduling_latency_s":0.650294}1410gitlab # [ 145.941737] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c1bd6938333bfd82810794a","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c1bd6938333bfd82810794a: done: 0.009176 sec","job_status":"done","queue_duration_s":0.650281,"scheduling_latency_s":0.650294,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009176,"completed_at":"2026-09-18T21:04:14.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 146.000721] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3232adc9f81c21520fe880","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3232adc9f81c21520fe880: start","job_status":"start","queue_duration_s":0.660358,"scheduling_latency_s":0.660371}1412gitlab # [ 146.001579] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d3232adc9f81c21520fe880","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d3232adc9f81c21520fe880: done: 0.009108 sec","job_status":"done","queue_duration_s":0.660358,"scheduling_latency_s":0.660371,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009108,"completed_at":"2026-09-18T21:04:14.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 146.022836] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6e8628324fc0313bf79afe5","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6e8628324fc0313bf79afe5: start","job_status":"start","queue_duration_s":0.67036,"scheduling_latency_s":0.670374}1414gitlab # [ 146.034173] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6e8628324fc0313bf79afe5","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6e8628324fc0313bf79afe5: done: 0.009144 sec","job_status":"done","queue_duration_s":0.67036,"scheduling_latency_s":0.670374,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009144,"completed_at":"2026-09-18T21:04:14.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 146.082985] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f1c2f8a679f9af52bce844f","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f1c2f8a679f9af52bce844f: start","job_status":"start","queue_duration_s":0.680388,"scheduling_latency_s":0.680402}1416gitlab # [ 146.083747] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f1c2f8a679f9af52bce844f","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f1c2f8a679f9af52bce844f: done: 0.009122 sec","job_status":"done","queue_duration_s":0.680388,"scheduling_latency_s":0.680402,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009122,"completed_at":"2026-09-18T21:04:14.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 146.135668] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db278ad91d1f1c37cbb5f1a6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db278ad91d1f1c37cbb5f1a6: start","job_status":"start","queue_duration_s":0.690473,"scheduling_latency_s":0.690486}1418gitlab # [ 146.136520] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db278ad91d1f1c37cbb5f1a6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db278ad91d1f1c37cbb5f1a6: done: 0.009278 sec","job_status":"done","queue_duration_s":0.690473,"scheduling_latency_s":0.690486,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009278,"completed_at":"2026-09-18T21:04:14.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 146.181794] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecd9578ef6847a7245c9aa1c","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecd9578ef6847a7245c9aa1c: start","job_status":"start","queue_duration_s":0.700861,"scheduling_latency_s":0.700874}1420gitlab # [ 146.182752] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecd9578ef6847a7245c9aa1c","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecd9578ef6847a7245c9aa1c: done: 0.00914 sec","job_status":"done","queue_duration_s":0.700861,"scheduling_latency_s":0.700874,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00914,"completed_at":"2026-09-18T21:04:14.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 146.244818] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a58e7d68ede2656bb99460f","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a58e7d68ede2656bb99460f: start","job_status":"start","queue_duration_s":0.710875,"scheduling_latency_s":0.710888}1422gitlab # [ 146.245736] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a58e7d68ede2656bb99460f","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a58e7d68ede2656bb99460f: done: 0.009075 sec","job_status":"done","queue_duration_s":0.710875,"scheduling_latency_s":0.710888,"redis_calls":13,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009075,"completed_at":"2026-09-18T21:04:14.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 146.253540] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dca389e4eee3503f1ce70ab0","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dca389e4eee3503f1ce70ab0: start","job_status":"start","queue_duration_s":0.720829,"scheduling_latency_s":0.720842}1424gitlab # [ 146.296896] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dca389e4eee3503f1ce70ab0","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dca389e4eee3503f1ce70ab0: done: 0.009003 sec","job_status":"done","queue_duration_s":0.720829,"scheduling_latency_s":0.720842,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009003,"completed_at":"2026-09-18T21:04:14.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 146.299591] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61b5c7bf9af3d069acd81c7e","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61b5c7bf9af3d069acd81c7e: start","job_status":"start","queue_duration_s":0.73077,"scheduling_latency_s":0.730783}1426gitlab # [ 146.310948] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61b5c7bf9af3d069acd81c7e","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61b5c7bf9af3d069acd81c7e: done: 0.00913 sec","job_status":"done","queue_duration_s":0.73077,"scheduling_latency_s":0.730783,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00913,"completed_at":"2026-09-18T21:04:14.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 146.366813] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f48da695e07bfad9dfe059e7","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f48da695e07bfad9dfe059e7: start","job_status":"start","queue_duration_s":0.740802,"scheduling_latency_s":0.740815}1428gitlab # [ 146.367727] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f48da695e07bfad9dfe059e7","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f48da695e07bfad9dfe059e7: done: 0.009079 sec","job_status":"done","queue_duration_s":0.740802,"scheduling_latency_s":0.740815,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009079,"completed_at":"2026-09-18T21:04:14.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 146.408085] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb8b625334b44a53e1ca25ac","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb8b625334b44a53e1ca25ac: start","job_status":"start","queue_duration_s":0.75075,"scheduling_latency_s":0.750763}1430gitlab # [ 146.408713] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb8b625334b44a53e1ca25ac","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb8b625334b44a53e1ca25ac: done: 0.009225 sec","job_status":"done","queue_duration_s":0.75075,"scheduling_latency_s":0.750763,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009225,"completed_at":"2026-09-18T21:04:14.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 146.448627] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05bcdcb5b4b3b6bc64d29f4a","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05bcdcb5b4b3b6bc64d29f4a: start","job_status":"start","queue_duration_s":0.761008,"scheduling_latency_s":0.761021}1432gitlab # [ 146.449593] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05bcdcb5b4b3b6bc64d29f4a","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05bcdcb5b4b3b6bc64d29f4a: done: 0.009185 sec","job_status":"done","queue_duration_s":0.761008,"scheduling_latency_s":0.761021,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009185,"completed_at":"2026-09-18T21:04:14.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 146.488577] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ae749ea9cf1badaf2c8ad65","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ae749ea9cf1badaf2c8ad65: start","job_status":"start","queue_duration_s":0.771041,"scheduling_latency_s":0.771055}1434gitlab # [ 146.494136] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ae749ea9cf1badaf2c8ad65","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ae749ea9cf1badaf2c8ad65: done: 0.009204 sec","job_status":"done","queue_duration_s":0.771041,"scheduling_latency_s":0.771055,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009204,"completed_at":"2026-09-18T21:04:14.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 146.529875] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f58e9378de64db40d92f06bb","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f58e9378de64db40d92f06bb: start","job_status":"start","queue_duration_s":0.78112,"scheduling_latency_s":0.781133}1436gitlab # [ 146.570913] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f58e9378de64db40d92f06bb","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f58e9378de64db40d92f06bb: done: 0.009155 sec","job_status":"done","queue_duration_s":0.78112,"scheduling_latency_s":0.781133,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009155,"completed_at":"2026-09-18T21:04:14.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 146.576083] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e31c481ec23d791245d4719","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e31c481ec23d791245d4719: start","job_status":"start","queue_duration_s":0.791206,"scheduling_latency_s":0.791219}1438gitlab # [ 146.587246] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e31c481ec23d791245d4719","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e31c481ec23d791245d4719: done: 0.009067 sec","job_status":"done","queue_duration_s":0.791206,"scheduling_latency_s":0.791219,"redis_calls":13,"redis_duration_s":0.001512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009067,"completed_at":"2026-09-18T21:04:14.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 146.642818] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f09a2f0c914cda2b99d3fbd","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f09a2f0c914cda2b99d3fbd: start","job_status":"start","queue_duration_s":0.801407,"scheduling_latency_s":0.801421}1440gitlab # [ 146.643746] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f09a2f0c914cda2b99d3fbd","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f09a2f0c914cda2b99d3fbd: done: 0.009147 sec","job_status":"done","queue_duration_s":0.801407,"scheduling_latency_s":0.801421,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009147,"completed_at":"2026-09-18T21:04:14.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 146.686814] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2453b5f7522b1cb5ba30a502","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2453b5f7522b1cb5ba30a502: start","job_status":"start","queue_duration_s":0.811401,"scheduling_latency_s":0.811414}1442gitlab # [ 146.687593] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2453b5f7522b1cb5ba30a502","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2453b5f7522b1cb5ba30a502: done: 0.009011 sec","job_status":"done","queue_duration_s":0.811401,"scheduling_latency_s":0.811414,"redis_calls":13,"redis_duration_s":0.001599,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009011,"completed_at":"2026-09-18T21:04:14.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 146.730213] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c43b8547d60969465b01f47a","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c43b8547d60969465b01f47a: start","job_status":"start","queue_duration_s":0.821323,"scheduling_latency_s":0.821336}1444gitlab # [ 146.730995] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c43b8547d60969465b01f47a","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c43b8547d60969465b01f47a: done: 0.009174 sec","job_status":"done","queue_duration_s":0.821323,"scheduling_latency_s":0.821336,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009174,"completed_at":"2026-09-18T21:04:14.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 146.787651] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4d4db719e343a478bc01d6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4d4db719e343a478bc01d6: start","job_status":"start","queue_duration_s":0.831344,"scheduling_latency_s":0.831357}1446gitlab # [ 146.788621] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4d4db719e343a478bc01d6","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4d4db719e343a478bc01d6: done: 0.010368 sec","job_status":"done","queue_duration_s":0.831344,"scheduling_latency_s":0.831357,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010368,"completed_at":"2026-09-18T21:04:14.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 146.808082] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2855de1eb1927af145374cd","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2855de1eb1927af145374cd: start","job_status":"start","queue_duration_s":0.842574,"scheduling_latency_s":0.842586}1448gitlab # [ 146.819033] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2855de1eb1927af145374cd","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2855de1eb1927af145374cd: done: 0.009887 sec","job_status":"done","queue_duration_s":0.842574,"scheduling_latency_s":0.842586,"redis_calls":13,"redis_duration_s":0.0017170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009887,"completed_at":"2026-09-18T21:04:14.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 146.886650] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c47f8d2742b12cc9de34fe59","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c47f8d2742b12cc9de34fe59: start","job_status":"start","queue_duration_s":0.853542,"scheduling_latency_s":0.853555}1450gitlab # [ 146.887517] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c47f8d2742b12cc9de34fe59","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c47f8d2742b12cc9de34fe59: done: 0.009755 sec","job_status":"done","queue_duration_s":0.853542,"scheduling_latency_s":0.853555,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009755,"completed_at":"2026-09-18T21:04:14.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 146.933339] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e55aeee4abb273f6e81a6746","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e55aeee4abb273f6e81a6746: start","job_status":"start","queue_duration_s":0.864458,"scheduling_latency_s":0.864472}1452gitlab # [ 146.933957] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e55aeee4abb273f6e81a6746","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e55aeee4abb273f6e81a6746: done: 0.009868 sec","job_status":"done","queue_duration_s":0.864458,"scheduling_latency_s":0.864472,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009868,"completed_at":"2026-09-18T21:04:14.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 146.976740] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d86ef37423860ab6fec3728e","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d86ef37423860ab6fec3728e: start","job_status":"start","queue_duration_s":0.875457,"scheduling_latency_s":0.875471}1454gitlab # [ 146.977633] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d86ef37423860ab6fec3728e","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d86ef37423860ab6fec3728e: done: 0.009825 sec","job_status":"done","queue_duration_s":0.875457,"scheduling_latency_s":0.875471,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009825,"completed_at":"2026-09-18T21:04:14.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 147.027455] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d0dd442c1cd222217aa3cf","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d0dd442c1cd222217aa3cf: start","job_status":"start","queue_duration_s":0.886385,"scheduling_latency_s":0.886399}1456gitlab # [ 147.028201] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d0dd442c1cd222217aa3cf","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d0dd442c1cd222217aa3cf: done: 0.009777 sec","job_status":"done","queue_duration_s":0.886385,"scheduling_latency_s":0.886399,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009777,"completed_at":"2026-09-18T21:04:14.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 147.038797] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faaa34dd250745bfed37439","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faaa34dd250745bfed37439: start","job_status":"start","queue_duration_s":0.89722,"scheduling_latency_s":0.897234}1458gitlab # [ 147.079671] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faaa34dd250745bfed37439","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faaa34dd250745bfed37439: done: 0.009988 sec","job_status":"done","queue_duration_s":0.89722,"scheduling_latency_s":0.897234,"redis_calls":13,"redis_duration_s":0.001835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009988,"completed_at":"2026-09-18T21:04:14.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 147.084730] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de9249d8bbee00323cbfe03d","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de9249d8bbee00323cbfe03d: start","job_status":"start","queue_duration_s":0.908067,"scheduling_latency_s":0.908105}1460gitlab # [ 147.095935] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de9249d8bbee00323cbfe03d","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de9249d8bbee00323cbfe03d: done: 0.010155 sec","job_status":"done","queue_duration_s":0.908067,"scheduling_latency_s":0.908105,"redis_calls":13,"redis_duration_s":0.0018579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010155,"completed_at":"2026-09-18T21:04:14.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 147.141638] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a59ba862cf297073be6931","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a59ba862cf297073be6931: start","job_status":"start","queue_duration_s":0.919058,"scheduling_latency_s":0.919071}1462gitlab # [ 147.142569] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:14.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a59ba862cf297073be6931","created_at":"2026-09-18T21:04:13.550Z","trace_propagation_headers":{"sentry-trace":"642171194c9a492680b9c67f75c7e9a2-9b2591809d3a4a67","baggage":"sentry-trace_id=642171194c9a492680b9c67f75c7e9a2,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e07db6f44aa4d8a2c8e99d191904ea10","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:04:13.597Z","job_size_bytes":2,"pid":1620,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a59ba862cf297073be6931: done: 0.00994 sec","job_status":"done","queue_duration_s":0.919058,"scheduling_latency_s":0.919071,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00994,"completed_at":"2026-09-18T21:04:14.525Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 147.364080] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2938421977 wd_nsec: 29384217471464gitlab # [ 160.736711] setup-gitlab-start[2218]: W, [2026-09-18T21:04:30.022889 #2218] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1465gitlab # [ 182.000221] postgres[2419]: [2419] ERROR: relation "table_without_models" does not exist1466gitlab # [ 182.003279] postgres[2419]: [2419] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1467gitlab # [ 184.885553] runuser[2217]: pam_unix(runuser:session): session closed for user gitlab1468gitlab # [ 184.886511] setup-gitlab-start[2199]: + systemctl restart gitlab-sidekiq.service1469gitlab # [ 184.922463] systemd[1]: Stopping gitlab-sidekiq.service...1470gitlab # [ 184.923764] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:54.208Z","message":"Shutting down"}1471gitlab # [ 184.924600] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:54.209Z","message":"Scheduler exiting..."}1472gitlab # [ 184.925501] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:54.209Z","message":"Terminating quiet threads for default capsule"}1473gitlab # [ 184.926212] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:54.209Z","message":"Scheduler exiting..."}1474gitlab # [ 185.424649] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:54.710Z","message":"Pausing to allow jobs to finish..."}1475gitlab # [ 185.928302] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:55.214Z","message":"Bye!"}1476gitlab # [ 185.952596] sidekiq-cluster[1620]: {"severity":"INFO","time":"2026-09-18T21:04:55.239Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1620,"worker_id":"sidekiq_0","memwd_rss_bytes":944328704,"retry":0}1477gitlab # [ 187.130311] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1478gitlab # [ 187.130928] systemd[1]: Stopped gitlab-sidekiq.service.1479gitlab # [ 187.132052] systemd[1]: gitlab-sidekiq.service: Consumed 55.805s CPU time over 1min 53.106s wall clock time, 937.4M memory peak, 4.4M read from disk.1480gitlab # [ 187.137815] systemd[1]: Started gitlab-sidekiq.service.1481gitlab # [ 187.140085] setup-gitlab-start[2199]: + mkdir -p /var/lib/secrets1482gitlab # [ 187.141752] setup-gitlab-start[2199]: + echo nixbot-test-token-of-20-chars1483gitlab # [ 187.142678] setup-gitlab-start[2199]: + chmod 644 /var/lib/secrets/gitlab-token1484gitlab # [ 187.145679] setup-gitlab-start[2199]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1485gitlab # [ 187.580497] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:04:56 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 4031486gitlab # [ 188.126452] gitaly[904]: time="2026-09-18T21:04:57.412Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.412" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 188.126966] gitaly[904]: time="2026-09-18T21:04:57.412Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.412" grpc.time_ms=0.252 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 188.219412] gitaly[904]: time="2026-09-18T21:04:57.506Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.505" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 188.242460] gitaly[904]: time="2026-09-18T21:04:57.506Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.505" grpc.time_ms=0.457 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 188.277359] gitaly[904]: time="2026-09-18T21:04:57.564Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ diskcache=5425ddbc-43ca-4d0e-8fa8-d29b8ca5335f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T21:05:07.100" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.511" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 188.293112] gitaly[904]: time="2026-09-18T21:04:57.564Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1578 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T21:05:07.100" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.511" grpc.time_ms=53.176 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 188.293617] gitaly[904]: time="2026-09-18T21:04:57.572Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.571" pid=904 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1493gitlab # [ 188.294280] gitaly[904]: time="2026-09-18T21:04:57.572Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.571" grpc.time_ms=0.41 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 188.324511] gitaly[904]: time="2026-09-18T21:04:57.611Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:05:07.164" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.574" grpc.time_ms=5.239 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 188.390457] gitaly[904]: time="2026-09-18T21:04:57.677Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.266" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.677" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 188.391354] gitaly[904]: time="2026-09-18T21:04:57.677Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.266" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.677" grpc.time_ms=0.306 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 188.444446] gitaly[904]: time="2026-09-18T21:04:57.731Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ diskcache=5367d7b7-0d69-442a-a356-43880a83ff96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T21:05:07.272" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.682" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 188.445250] gitaly[904]: time="2026-09-18T21:04:57.731Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-18T21:05:07.272" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.682" grpc.time_ms=49.16 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 188.476256] gitaly[904]: time="2026-09-18T21:04:57.763Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.762" pid=904 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1500gitlab # [ 188.477107] gitaly[904]: time="2026-09-18T21:04:57.763Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.762" grpc.time_ms=0.398 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 188.507335] gitaly[904]: time="2026-09-18T21:04:57.794Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:05:07.026" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.786" grpc.time_ms=7.504 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1502gitlab # [ 188.544994] gitaly[904]: time="2026-09-18T21:04:57.831Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:05:07.071" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.831" grpc.time_ms=0.122 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1503gitlab # [ 188.555749] gitaly[904]: time="2026-09-18T21:04:57.842Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T21:05:07.082" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:57.842" grpc.time_ms=0.161 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1504gitlab # [ 189.041273] gitaly[904]: time="2026-09-18T21:04:58.328Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CC1S4B5YWEKHNVMCSTHJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:05:08.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:04:58.319" grpc.time_ms=8.575 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1505gitlab # [ 189.414274] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:04:58 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 18101506gitlab # [ 189.420505] setup-gitlab-start[2466]: {"id":1,"message":null,"error":null}1507gitlab # [ 190.245093] sidekiq-cluster[2453]: {"severity":"INFO","time":"2026-09-18T21:04:59.514Z","message":"Starting cluster with 1 processes"}1508gitlab # [ 194.521455] gitaly[904]: time="2026-09-18T21:05:03.808Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CJQFAEDH05NYG7Z99846 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:05:13.036" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:03.797" grpc.time_ms=10.848 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1509gitlab # [ 194.564328] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:03 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1221510gitlab # [ 194.567981] setup-gitlab-start[2199]: + mkdir -p /tmp/test-flake1511gitlab # [ 194.571192] setup-gitlab-start[2199]: + cd /tmp/test-flake1512gitlab # [ 194.571522] setup-gitlab-start[2199]: + git init -b master1513gitlab # [ 194.590959] setup-gitlab-start[2540]: Initialized empty Git repository in /tmp/test-flake/.git/1514gitlab # [ 194.591803] setup-gitlab-start[2199]: + git config user.name test1515gitlab # [ 194.593225] setup-gitlab-start[2199]: + git config user.email test@example.com1516gitlab # [ 194.595132] setup-gitlab-start[2199]: + cat1517gitlab # [ 194.597164] setup-gitlab-start[2199]: + git add flake.nix1518gitlab # [ 194.603219] setup-gitlab-start[2199]: + git commit -m 'initial commit'1519gitlab # [ 194.624449] setup-gitlab-start[2545]: [master (root-commit) 79f342e] initial commit1520gitlab # [ 194.624757] setup-gitlab-start[2545]: 1 file changed, 10 insertions(+)1521gitlab # [ 194.625416] setup-gitlab-start[2545]: create mode 100644 flake.nix1522gitlab # [ 194.625943] setup-gitlab-start[2199]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1523gitlab # [ 194.633343] setup-gitlab-start[2199]: + git push -u origin master1524gitlab # [ 194.704536] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 471525gitlab # [ 194.805722] gitaly[904]: time="2026-09-18T21:05:04.092Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CJZRDY3DQTG8E3A4RZCV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:04.084" grpc.time_ms=8.176 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1526gitlab # [ 194.806458] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:04 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1001527gitlab # [ 195.170512] gitaly[904]: time="2026-09-18T21:05:04.457Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:05:14.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:04.448" grpc.time_ms=8.387 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 195.218086] gitaly[904]: time="2026-09-18T21:05:04.504Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-18T21:05:34.093" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-18T21:05:04.494" grpc.time_ms=10.636 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1529gitlab # [ 195.253882] gitaly[904]: time="2026-09-18T21:05:04.540Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 duration_ms=319ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/allowed"1530gitlab # [ 195.278138] gitaly[904]: time="2026-09-18T21:05:04.565Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 duration_ms=23ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/pre_receive"1531gitlab # [ 195.284388] gitaly[904]: time="2026-09-18T21:05:04.571Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:04.220" grpc.time_ms=350.567 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 195.335427] gitaly[904]: time="2026-09-18T21:05:04.622Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:04.621" grpc.time_ms=0.511 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1533gitlab # [ 195.370565] gitaly[904]: time="2026-09-18T21:05:04.657Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:04.656" grpc.time_ms=0.467 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1534gitlab # [ 195.398855] gitaly[904]: time="2026-09-18T21:05:04.685Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:04.685" grpc.time_ms=0.245 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1535gitlab # [ 195.516429] gitaly[904]: time="2026-09-18T21:05:04.803Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:05:14.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:04.791" grpc.time_ms=11.06 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 195.575928] gitaly[904]: time="2026-09-18T21:05:04.862Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-18T21:05:14.048" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:04.838" grpc.time_ms=23.387 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1537gitlab # [ 195.604204] gitaly[904]: time="2026-09-18T21:05:04.891Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 duration_ms=171ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/post_receive"1538gitlab # [ 195.609995] gitaly[904]: time="2026-09-18T21:05:04.896Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:04.717" grpc.time_ms=179.274 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 195.634061] gitaly[904]: time="2026-09-18T21:05:04.921Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 diskcache=d22fd6b4-abb9-4143-b331-4bc13f616254 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:04.155" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1540gitlab # [ 195.635801] gitlab-workhorse[823]: time="2026-09-18T21:05:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521541gitlab # [ 195.636925] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:04 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8201542gitlab # [ 195.638451] setup-gitlab-start[2549]: To http://gitlab/root/test-flake.git1543gitlab # [ 195.639236] setup-gitlab-start[2549]: * [new branch] master -> master1544gitlab # [ 195.641298] setup-gitlab-start[2549]: branch 'master' set up to track 'origin/master'.1545gitlab # [ 195.643383] systemd[1]: Finished setup-gitlab.service.1546gitlab # [ 195.650677] gitaly[904]: time="2026-09-18T21:05:04.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=176 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13933 command.oublock=32 command.real_time_ms=756 command.spawn_token_fork_ms=2 command.system_time_ms=116 command.user_time_ms=60 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:04.155" grpc.time_ms=765.779 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1547gitlab # [ 195.663610] systemd[1]: Starting nixbot CI service...1548gitlab: (finished: waiting for unit setup-gitlab.service, in 196.71 seconds)1549gitlab: waiting for unit nixbot.service1550gitlab # [ 196.935527] nixbot[2634]: {"ts": "2026-09-18T21:05:06.221Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1551gitlab # [ 196.967650] nixbot[2634]: {"ts": "2026-09-18T21:05:06.254Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1552gitlab # [ 196.982639] nixbot[2634]: {"ts": "2026-09-18T21:05:06.269Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1553gitlab # [ 196.986618] nixbot[2634]: {"ts": "2026-09-18T21:05:06.273Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1554gitlab # [ 196.990173] nixbot[2634]: {"ts": "2026-09-18T21:05:06.277Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1555gitlab # [ 196.994453] nixbot[2634]: {"ts": "2026-09-18T21:05:06.281Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1556gitlab # [ 196.997890] nixbot[2634]: {"ts": "2026-09-18T21:05:06.284Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1557gitlab # [ 197.001342] nixbot[2634]: {"ts": "2026-09-18T21:05:06.288Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1558gitlab # [ 197.008179] nixbot[2634]: {"ts": "2026-09-18T21:05:06.294Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1559gitlab # [ 197.012766] nixbot[2634]: {"ts": "2026-09-18T21:05:06.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1560gitlab # [ 197.019040] nixbot[2634]: {"ts": "2026-09-18T21:05:06.305Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1561gitlab # [ 197.026231] nixbot[2634]: {"ts": "2026-09-18T21:05:06.313Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1562gitlab # [ 197.031165] nixbot[2634]: {"ts": "2026-09-18T21:05:06.318Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1563gitlab # [ 197.035931] nixbot[2634]: {"ts": "2026-09-18T21:05:06.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1564gitlab # [ 197.041410] nixbot[2634]: {"ts": "2026-09-18T21:05:06.328Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1565gitlab # [ 197.046161] nixbot[2634]: {"ts": "2026-09-18T21:05:06.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1566gitlab # [ 197.052104] nixbot[2634]: {"ts": "2026-09-18T21:05:06.338Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1567gitlab # [ 197.054055] nixbot[2634]: {"ts": "2026-09-18T21:05:06.340Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1568gitlab # [ 197.060051] nixbot[2634]: {"ts": "2026-09-18T21:05:06.346Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1569gitlab # [ 197.064064] nixbot[2634]: {"ts": "2026-09-18T21:05:06.350Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1570gitlab # [ 197.067563] nixbot[2634]: {"ts": "2026-09-18T21:05:06.354Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1571gitlab # [ 197.073079] nixbot[2634]: {"ts": "2026-09-18T21:05:06.359Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1572gitlab # [ 197.077181] nixbot[2634]: {"ts": "2026-09-18T21:05:06.364Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1573gitlab # [ 197.082514] nixbot[2634]: {"ts": "2026-09-18T21:05:06.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1574gitlab # [ 197.087739] nixbot[2634]: {"ts": "2026-09-18T21:05:06.374Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1575gitlab # [ 197.092251] nixbot[2634]: {"ts": "2026-09-18T21:05:06.379Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1576gitlab # [ 197.096347] nixbot[2634]: {"ts": "2026-09-18T21:05:06.383Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1577gitlab # [ 197.100159] nixbot[2634]: {"ts": "2026-09-18T21:05:06.387Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1578gitlab # [ 197.104191] nixbot[2634]: {"ts": "2026-09-18T21:05:06.391Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1579gitlab # [ 197.119979] nixbot[2634]: {"ts": "2026-09-18T21:05:06.406Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1580gitlab # [ 197.124289] nixbot[2634]: {"ts": "2026-09-18T21:05:06.411Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1581gitlab # [ 197.126807] nixbot[2634]: {"ts": "2026-09-18T21:05:06.413Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1582gitlab # [ 197.129237] nixbot[2634]: {"ts": "2026-09-18T21:05:06.416Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1583gitlab # [ 197.133306] nixbot[2634]: {"ts": "2026-09-18T21:05:06.420Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1584gitlab # [ 197.135849] nixbot[2634]: {"ts": "2026-09-18T21:05:06.422Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1585gitlab # [ 197.146550] nixbot[2634]: {"ts": "2026-09-18T21:05:06.433Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1586gitlab # [ 197.152334] nixbot[2634]: {"ts": "2026-09-18T21:05:06.439Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1587gitlab # [ 197.491752] nixbot[2634]: INFO: Started server process [2634]1588gitlab # [ 197.492047] nixbot[2634]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1589gitlab # [ 197.508052] nixbot[2634]: INFO: ::ffff:127.0.0.1:48324 - "GET /health HTTP/1.1" 200 OK1590gitlab # [ 197.514221] systemd[1]: Started nixbot CI service.1591gitlab # [ 197.514847] systemd[1]: Reached target Multi-User System.1592gitlab # [ 197.517290] systemd[1]: Startup finished in 1.263s (kernel) + 3.470s (initrd) + 3min 12.783s (userspace) = 3min 17.517s.1593gitlab # [ 197.712095] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:06 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2031594gitlab # [ 197.713485] nixbot[2634]: {"ts": "2026-09-18T21:05:07.000Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1595gitlab # [ 197.729595] nixbot[2634]: {"ts": "2026-09-18T21:05:07.016Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1596gitlab # [ 197.832358] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 911597gitlab # [ 197.833787] nixbot[2634]: {"ts": "2026-09-18T21:05:07.120Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1598gitlab # [ 197.836162] nixbot[2634]: {"ts": "2026-09-18T21:05:07.123Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1599gitlab # [ 197.949598] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1101600gitlab # [ 197.955964] nixbot[2634]: {"ts": "2026-09-18T21:05:07.242Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1601gitlab # [ 198.066641] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 971602gitlab # [ 198.073045] nixbot[2634]: {"ts": "2026-09-18T21:05:07.359Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1603gitlab: (finished: waiting for unit nixbot.service, in 2.07 seconds)1604gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1605gitlab # [ 198.151101] nixbot[2634]: INFO: ::ffff:127.0.0.1:48330 - "GET /health HTTP/1.1" 200 OK1606gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1607subtest: project discovered and webhook registered1608gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1609gitlab # [ 198.161042] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 701610gitlab # [ 198.165971] nixbot[2634]: {"ts": "2026-09-18T21:05:07.452Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1611gitlab # [ 198.232110] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 451612gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1613(finished: subtest: project discovered and webhook registered, in 0.08 seconds)1614subtest: push delivers the webhook1615gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1616gitlab # [ 198.253195] nixbot[2634]: {"ts": "2026-09-18T21:05:07.540Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1617gitlab # [ 198.253824] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 781618gitlab # [ 198.306717] gitaly[904]: time="2026-09-18T21:05:07.591Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPEVACC2FJBVKVKZ2KSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-18T21:05:37.079" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:07.579" grpc.time_ms=12.081 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 198.331992] gitaly[904]: time="2026-09-18T21:05:07.618Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPEVACC2FJBVKVKZ2KSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:05:37.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:07.618" grpc.time_ms=0.553 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 198.340559] gitaly[904]: time="2026-09-18T21:05:07.627Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPEVACC2FJBVKVKZ2KSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-18T21:05:17.210" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:07.621" grpc.time_ms=6.262 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 198.394398] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1331622gitlab # [ 198.395408] nixbot[2634]: {"ts": "2026-09-18T21:05:07.682Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1623gitlab # [ 198.557935] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1571624gitlab # [ 198.559392] nixbot[2634]: {"ts": "2026-09-18T21:05:07.846Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1625gitlab # [ 198.563685] nixbot[2634]: {"ts": "2026-09-18T21:05:07.850Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1626gitlab # [ 198.656321] gitaly[904]: time="2026-09-18T21:05:07.942Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CPSP1J311E43DVMQWG72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:07.931" grpc.time_ms=10.63 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1627gitlab # [ 198.659514] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 481628gitlab # [ 198.738817] gitaly[904]: time="2026-09-18T21:05:08.025Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPV8VZ5ANGCW1FYTY6N5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.012" pid=904 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1629gitlab # [ 198.739764] gitaly[904]: time="2026-09-18T21:05:08.025Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPV8VZ5ANGCW1FYTY6N5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.012" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1630gitlab # [ 198.741664] gitaly[904]: time="2026-09-18T21:05:08.026Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPV8VZ5ANGCW1FYTY6N5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.012" grpc.time_ms=13.57 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1631gitlab # [ 198.799771] gitlab-workhorse[823]: time="2026-09-18T21:05:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131632gitlab # [ 198.802463] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1411633gitlab # [ 198.882638] gitaly[904]: time="2026-09-18T21:05:08.169Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPZSPDDBC6QG5GF6G8GD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.157" pid=904 remote_ip="2001:db8:1::1" request_sha=4262f51e95469d412139a40be1a25d288097ffb4 response_bytes=224 span.kind=server system=grpc1634gitlab # [ 198.905781] gitaly[904]: time="2026-09-18T21:05:08.169Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPZSPDDBC6QG5GF6G8GD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.157" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1635gitlab # [ 198.929838] gitlab-workhorse[823]: time="2026-09-18T21:05:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241636gitlab # [ 198.931854] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 781637gitlab # [ 198.932234] gitaly[904]: time="2026-09-18T21:05:08.169Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CPZSPDDBC6QG5GF6G8GD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.157" grpc.time_ms=12.703 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1638gitlab # [ 198.985797] gitaly[904]: time="2026-09-18T21:05:08.272Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQ49J11NET0MP56SSMGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.266" grpc.time_ms=5.984 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1639gitlab # [ 199.006133] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391640gitlab # [ 199.031809] gitaly[904]: time="2026-09-18T21:05:08.318Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQ5JR1KRYFFT3342R242 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.311" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1641gitlab # [ 199.032115] gitaly[904]: time="2026-09-18T21:05:08.318Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQ5JR1KRYFFT3342R242 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.311" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1642gitlab # [ 199.032955] gitaly[904]: time="2026-09-18T21:05:08.319Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQ5JR1KRYFFT3342R242 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.311" grpc.time_ms=8.537 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 199.066146] gitlab-workhorse[823]: time="2026-09-18T21:05:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671644gitlab # [ 199.066793] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 781645gitlab # [ 199.132778] gitaly[904]: time="2026-09-18T21:05:08.419Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQ8V6C186Z70TND3MYHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.413" grpc.time_ms=6.205 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1646gitlab # [ 199.146359] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 531647gitlab # [ 199.209771] gitaly[904]: time="2026-09-18T21:05:08.496Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQAMHNWAJTEG0AG1MA8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.475" pid=904 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1648gitlab # [ 199.210068] gitaly[904]: time="2026-09-18T21:05:08.496Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQAMHNWAJTEG0AG1MA8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.475" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1649gitlab # [ 199.210963] gitaly[904]: time="2026-09-18T21:05:08.497Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQAMHNWAJTEG0AG1MA8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:08.475" grpc.time_ms=21.392 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1650gitlab # [ 199.212778] gitlab-workhorse[823]: time="2026-09-18T21:05:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091651gitlab # [ 199.213958] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 611652gitlab # [ 199.330992] gitaly[904]: time="2026-09-18T21:05:08.617Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:05:38.216" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:08.616" grpc.time_ms=0.447 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 199.357810] gitaly[904]: time="2026-09-18T21:05:08.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-18T21:05:38.238" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:08.639" grpc.time_ms=5.631 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 199.381738] gitaly[904]: time="2026-09-18T21:05:08.668Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:05:18.223" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:08.663" grpc.time_ms=5.309 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 199.404228] gitaly[904]: time="2026-09-18T21:05:08.691Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:05:18.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:08.686" grpc.time_ms=4.946 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 199.484280] gitaly[904]: time="2026-09-18T21:05:08.771Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T21:05:18.000" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:08.770" grpc.time_ms=0.207 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 199.529185] gitaly[904]: time="2026-09-18T21:05:08.815Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T21:05:18.014" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:08.804" grpc.time_ms=10.918 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 199.611721] gitaly[904]: time="2026-09-18T21:05:08.898Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:08.897" grpc.time_ms=0.686 pid=904 span.kind=server system=grpc1659gitlab # [ 199.668262] gitaly[904]: time="2026-09-18T21:05:08.954Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:08.953" grpc.time_ms=0.925 pid=904 span.kind=server system=grpc1660gitlab # [ 199.695543] gitaly[904]: time="2026-09-18T21:05:08.982Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 diskcache=0bf61c6c-b763-495a-9279-b866442baaa9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:05:18.053" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:08.844" pid=904 ref=refs/keep-around/79f342e778e69e791392ca7ab634b2ccb8669e2c remote_ip="2001:db8:1::1" revision=79f342e778e69e791392ca7ab634b2ccb8669e2c span.kind=server system=grpc username=root1661gitlab # [ 199.708073] gitaly[904]: time="2026-09-18T21:05:08.994Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=116 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5596 command.oublock=8 command.real_time_ms=128 command.spawn_token_fork_ms=0 command.system_time_ms=74 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:05:18.053" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:08.844" grpc.time_ms=138.342 pid=904 ref=refs/keep-around/79f342e778e69e791392ca7ab634b2ccb8669e2c remote_ip="2001:db8:1::1" revision=79f342e778e69e791392ca7ab634b2ccb8669e2c span.kind=server system=grpc username=root1662gitlab # [ 199.726161] gitaly[904]: time="2026-09-18T21:05:09.013Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:05:39.012" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:09.012" grpc.time_ms=0.335 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 199.883419] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5911664gitlab # [ 199.884307] nixbot[2634]: {"ts": "2026-09-18T21:05:09.170Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1665gitlab # [ 199.904633] nixbot[2634]: {"ts": "2026-09-18T21:05:09.191Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-79f342e778e6-0"}1666gitlab # [ 200.056713] nixbot[2634]: {"ts": "2026-09-18T21:05:09.343Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-79f342e778e6-0", "argv0": "bwrap"}1667gitlab # [ 200.130971] systemd[1]: Started Nix Daemon.1668gitlab # [ 200.195966] nix-daemon[2793]: accepted connection from pid 2788, user nixbot1669gitlab # [ 204.996781] nix-daemon[2793]: accepted connection from pid 2842, user nixbot1670gitlab # [ 205.012332] nix-daemon[2793]: accepted connection from pid 2788, user nixbot1671gitlab # [ 209.386907] nix-daemon[2793]: accepted connection from pid 2788, user nixbot1672gitlab # [ 209.474182] nix-daemon[2793]: accepted connection from pid 2885, user nixbot1673gitlab # [ 209.505412] gitaly[904]: time="2026-09-18T21:05:18.791Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D1D0KFFS0VV9VEKRKMG9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:05:48.390" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:18.790" grpc.time_ms=0.61 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 209.653324] gitaly[904]: time="2026-09-18T21:05:18.940Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2V5D1D0KFFS0VV9VEKRKMG9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:05:28.138" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:18.928" grpc.time_ms=10.722 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 209.721301] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2511676gitlab # [ 209.722670] nixbot[2634]: {"ts": "2026-09-18T21:05:19.006Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1677gitlab # [ 209.774800] gitaly[904]: time="2026-09-18T21:05:19.061Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D1NERM66WD53RTET5NZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:05:49.059" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:19.060" grpc.time_ms=0.979 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 209.836769] gitaly[904]: time="2026-09-18T21:05:19.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5D1NERM66WD53RTET5NZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:05:29.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:19.109" grpc.time_ms=14.215 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 209.904245] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1681680gitlab # [ 209.910826] nixbot[2634]: {"ts": "2026-09-18T21:05:19.197Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1681gitlab # [ 214.009693] nix-daemon[2793]: accepted connection from pid 2959, user nixbot1682gitlab # [ 214.108237] gitaly[904]: time="2026-09-18T21:05:23.394Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D5VV4SHZYZ03ZRKK2YCY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:05:53.392" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:23.393" grpc.time_ms=0.975 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 214.150940] gitaly[904]: time="2026-09-18T21:05:23.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5D5VV4SHZYZ03ZRKK2YCY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:05:33.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:23.427" grpc.time_ms=10.18 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 214.182636] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1451685gitlab # [ 214.187693] nixbot[2634]: {"ts": "2026-09-18T21:05:23.470Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1686gitlab # [ 214.486274] gitaly[904]: time="2026-09-18T21:05:23.773Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5D68F0C6HGMMCSQBS80X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:23.761" grpc.time_ms=11.433 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 214.487112] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 461688gitlab # [ 214.540347] gitaly[904]: time="2026-09-18T21:05:23.827Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D69Z4Q0T2KJZQ1BAZ6X7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:23.817" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1689gitlab # [ 214.559138] gitaly[904]: time="2026-09-18T21:05:23.827Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D69Z4Q0T2KJZQ1BAZ6X7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:23.817" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1690gitlab # [ 214.573855] gitlab-workhorse[823]: time="2026-09-18T21:05:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671691gitlab # [ 214.574556] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 521692gitlab # [ 214.575306] gitaly[904]: time="2026-09-18T21:05:23.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D69Z4Q0T2KJZQ1BAZ6X7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:23.817" grpc.time_ms=10.301 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1693gitlab # [ 214.661592] gitaly[904]: time="2026-09-18T21:05:23.948Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5D6DPWA9TW90S9WAM417W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:23.939" grpc.time_ms=8.294 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 214.662686] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551695gitlab # [ 214.721507] gitaly[904]: time="2026-09-18T21:05:24.008Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D6G0M9FK9SPB0YFC720T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:24.001" pid=904 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1696gitlab # [ 214.721804] gitaly[904]: time="2026-09-18T21:05:24.008Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D6G0M9FK9SPB0YFC720T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:24.001" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1697gitlab # [ 214.752138] gitaly[904]: time="2026-09-18T21:05:24.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5D6G0M9FK9SPB0YFC720T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:24.001" grpc.time_ms=37.048 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 214.765472] gitlab-workhorse[823]: time="2026-09-18T21:05:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671699gitlab # [ 214.765732] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 711700gitlab # [ 215.104973] sidekiq-cluster[2512]: 2026-09-18T21:05:24.391Z pid=2512 tid=xvc INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2512, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>437153792}1701gitlab # [ 215.275654] sidekiq-cluster[2512]: W, [2026-09-18T21:05:24.562432 #2512] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1702gitlab # [ 215.313123] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:24.599Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1703gitlab # [ 217.004971] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:26.291Z","message":"GitLab reliable fetch activated!"}1704gitlab # [ 217.005221] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:26.291Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1705gitlab # [ 236.336454] postgres[3184]: [3184] ERROR: relation "table_without_models" does not exist1706gitlab # [ 236.336840] postgres[3184]: [3184] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1707gitlab # [ 238.694365] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:47.980Z","message":"Booted Rails 7.2.3.1 application in production environment"}1708gitlab # [ 238.696198] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:47.983Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1709gitlab # [ 238.696648] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:47.983Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1710gitlab # [ 238.697125] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:47.983Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1711gitlab # [ 238.700875] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:47.987Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1712gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 41.33 seconds)1713gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1714gitlab # [ 239.660171] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 451715gitlab # [ 239.735865] gitaly[904]: time="2026-09-18T21:05:49.022Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYWKQXZ6NGW4XZATVCRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:49.015" grpc.time_ms=6.273 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1716gitlab # [ 239.747651] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 741717gitlab # Enumerating objects: 5, done.1718gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1719gitlab # Delta compression using up to 4 threads1720gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1721gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1722gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1723gitlab # [ 239.918716] gitaly[904]: time="2026-09-18T21:05:49.205Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-18T21:06:19.099" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-18T21:05:49.199" grpc.time_ms=6.113 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 239.943443] gitaly[904]: time="2026-09-18T21:05:49.230Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT duration_ms=78ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/allowed"1725gitlab # [ 239.963101] gitaly[904]: time="2026-09-18T21:05:49.250Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT duration_ms=18ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/pre_receive"1726gitlab # [ 239.963655] gitaly[904]: time="2026-09-18T21:05:49.250Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:49.151" grpc.time_ms=99.475 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1727gitlab # [ 239.996312] gitaly[904]: time="2026-09-18T21:05:49.283Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:49.282" grpc.time_ms=0.465 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728gitlab # [ 240.030435] gitaly[904]: time="2026-09-18T21:05:49.317Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:49.317" grpc.time_ms=0.305 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 240.056670] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.343Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ffe98aeb3aa4831e1f9eb873","created_at":"2026-09-18T21:04:57.631Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:57.655Z","job_size_bytes":2,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ffe98aeb3aa4831e1f9eb873: start","job_status":"start","queue_duration_s":51.687549,"scheduling_latency_s":51.687594}1730gitlab # [ 240.060374] gitaly[904]: time="2026-09-18T21:05:49.346Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:49.346" grpc.time_ms=0.257 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1731gitlab # [ 240.142691] gitaly[904]: time="2026-09-18T21:05:49.429Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT duration_ms=41ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/post_receive"1732gitlab # [ 240.147344] gitaly[904]: time="2026-09-18T21:05:49.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:49.386" grpc.time_ms=43.56 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab # [ 240.159774] gitaly[904]: time="2026-09-18T21:05:49.446Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT diskcache=93478f4e-a9da-470e-a0f4-00bcc3f825dc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:49.103" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1734gitlab # [ 240.160621] gitaly[904]: time="2026-09-18T21:05:49.446Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13503 command.oublock=32 command.real_time_ms=332 command.spawn_token_fork_ms=1 command.system_time_ms=87 command.user_time_ms=49 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:49.103" grpc.time_ms=343.231 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab # [ 240.161495] gitlab-workhorse[823]: time="2026-09-18T21:05:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521736gitlab # [ 240.162091] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:49 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 3981737gitlab # [ 240.183586] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.470Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ffe98aeb3aa4831e1f9eb873","created_at":"2026-09-18T21:04:57.631Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:57.655Z","job_size_bytes":2,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ffe98aeb3aa4831e1f9eb873: done: 0.127359 sec","job_status":"done","queue_duration_s":51.687549,"scheduling_latency_s":51.687594,"redis_calls":25,"redis_duration_s":0.0043289999999999995,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002091,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.064156478,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.127359,"completed_at":"2026-09-18T21:05:49.470Z","load_balancing_strategy":"primary","db_duration_s":0.036994,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1738gitlab # [ 240.185825] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.472Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"989129d7cbc9f02d438c1534","created_at":"2026-09-18T21:04:57.663Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:57.669Z","job_size_bytes":2,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-989129d7cbc9f02d438c1534: start","job_status":"start","queue_duration_s":51.803196,"scheduling_latency_s":51.803213}1739gitlab # To http://gitlab/root/test-flake.git1740gitlab # 79f342e..82a45f0 master -> master1741gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.68 seconds)1742gitlab: must succeed: git -C /tmp/test-flake rev-parse master1743gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1744gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821'1745gitlab # [ 240.260291] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.546Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"989129d7cbc9f02d438c1534","created_at":"2026-09-18T21:04:57.663Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:57.669Z","job_size_bytes":2,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-989129d7cbc9f02d438c1534: done: 0.074263 sec","job_status":"done","queue_duration_s":51.803196,"scheduling_latency_s":51.803213,"redis_calls":14,"redis_duration_s":0.002329,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.055043589000000004,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.074263,"completed_at":"2026-09-18T21:05:49.546Z","load_balancing_strategy":"primary","db_duration_s":0.013835,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1746gitlab # [ 240.302112] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.588Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0fe6ca6607c2c5b4835f4ccf","created_at":"2026-09-18T21:04:58.221Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:58.226Z","job_size_bytes":5,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0fe6ca6607c2c5b4835f4ccf: start","job_status":"start","queue_duration_s":51.362383,"scheduling_latency_s":51.362407}1747gitlab # [ 240.322720] nixbot[2634]: INFO: ::ffff:127.0.0.1:57208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 200 OK1748gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821', in 0.07 seconds)1749gitlab # [ 240.413944] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.700Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0fe6ca6607c2c5b4835f4ccf","created_at":"2026-09-18T21:04:58.221Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:58.226Z","job_size_bytes":5,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0fe6ca6607c2c5b4835f4ccf: done: 0.11187 sec","job_status":"done","queue_duration_s":51.362383,"scheduling_latency_s":51.362407,"redis_calls":12,"redis_duration_s":0.002272,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001472,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030814,"duration_s":0.11187,"completed_at":"2026-09-18T21:05:49.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020974,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1750gitlab # [ 240.486886] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.773Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"dde044f01e25a92b877b7af5","created_at":"2026-09-18T21:04:58.246Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:58.250Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-dde044f01e25a92b877b7af5: start","job_status":"start","queue_duration_s":51.522912,"scheduling_latency_s":51.522942}1751gitlab # [ 240.645781] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.932Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"dde044f01e25a92b877b7af5","created_at":"2026-09-18T21:04:58.246Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:58.250Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-dde044f01e25a92b877b7af5: done: 0.159185 sec","job_status":"done","queue_duration_s":51.522912,"scheduling_latency_s":51.522942,"redis_calls":11,"redis_duration_s":0.002928,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000693,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.126,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.126,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358426,"duration_s":0.159185,"completed_at":"2026-09-18T21:05:49.932Z","load_balancing_strategy":"primary","db_duration_s":0.071007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1752gitlab # [ 240.647625] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.934Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e1c68c401b4d270df211c576","created_at":"2026-09-18T21:04:58.252Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:58.255Z","job_size_bytes":89,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e1c68c401b4d270df211c576: start","job_status":"start","queue_duration_s":51.678405,"scheduling_latency_s":51.678419}1753gitlab # [ 240.679572] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.960Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e1c68c401b4d270df211c576","created_at":"2026-09-18T21:04:58.252Z","trace_propagation_headers":{"sentry-trace":"428078135e02414085bc78109668166b-b4924914a3e04be5","baggage":"sentry-trace_id=428078135e02414085bc78109668166b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CC1S4B5YWEKHNVMCSTHJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-18T21:04:58.255Z","job_size_bytes":89,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e1c68c401b4d270df211c576: done: 0.025987 sec","job_status":"done","queue_duration_s":51.678405,"scheduling_latency_s":51.678419,"redis_calls":11,"redis_duration_s":0.0025499999999999997,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00073,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000323505,"duration_s":0.025987,"completed_at":"2026-09-18T21:05:49.959Z","load_balancing_strategy":"primary","db_duration_s":0.005482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754gitlab # [ 240.744080] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.961Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 79f342e778e69e791392ca7ab634b2ccb8669e2c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d5b278ec5fb573501f75a31a","created_at":"2026-09-18T21:05:04.747Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-c63109026c7b4762","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:05:04.768Z","job_size_bytes":185,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d5b278ec5fb573501f75a31a: start","job_status":"start","queue_duration_s":45.193087,"scheduling_latency_s":45.193101}1755gitlab # [ 240.754398] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:49.972Z","message":"changes: \"0000000000000000000000000000000000000000 79f342e778e69e791392ca7ab634b2ccb8669e2c refs/heads/master\\n\""}1756gitlab # [ 240.757467] gitaly[904]: time="2026-09-18T21:05:50.002Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:05:59.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:49.992" grpc.time_ms=9.227 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 240.805318] gitaly[904]: time="2026-09-18T21:05:50.012Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:06:00.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:50.006" grpc.time_ms=5.285 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 240.806237] gitaly[904]: time="2026-09-18T21:05:50.058Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-18T21:06:00.044" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:50.045" grpc.time_ms=13.044 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 240.839951] gitaly[904]: time="2026-09-18T21:05:50.126Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:50.126" grpc.time_ms=0.402 pid=904 span.kind=server system=grpc1760gitlab # [ 240.878196] gitaly[904]: time="2026-09-18T21:05:50.165Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:50.164" grpc.time_ms=0.457 pid=904 span.kind=server system=grpc1761gitlab # [ 240.898356] gitaly[904]: time="2026-09-18T21:05:50.185Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 diskcache=7f1f0580-a503-4e7e-8b7c-11bcb33fe627 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:00.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:50.069" pid=904 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1762gitlab # [ 240.899175] gitaly[904]: time="2026-09-18T21:05:50.185Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4974 command.oublock=8 command.real_time_ms=106 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:00.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:50.069" grpc.time_ms=115.684 pid=904 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1763gitlab # [ 240.912529] gitaly[904]: time="2026-09-18T21:05:50.199Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-18T21:06:00.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:50.199" grpc.time_ms=0.265 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 240.927763] gitaly[904]: time="2026-09-18T21:05:50.214Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-18T21:06:00.202" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:50.202" grpc.time_ms=11.929 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 240.990359] gitaly[904]: time="2026-09-18T21:05:50.277Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-18T21:06:20.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:50.271" grpc.time_ms=5.668 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 241.026459] gitaly[904]: time="2026-09-18T21:05:50.313Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T21:06:00.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:50.312" grpc.time_ms=0.25 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 241.035539] gitaly[904]: time="2026-09-18T21:05:50.322Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-18T21:06:00.005" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-18T21:05:50.315" grpc.time_ms=7.042 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 241.074068] gitaly[904]: time="2026-09-18T21:05:50.360Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:00.040" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:50.350" grpc.time_ms=10.194 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 241.091149] gitaly[904]: time="2026-09-18T21:05:50.377Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:00.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:50.367" grpc.time_ms=10.213 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 241.119401] gitaly[904]: time="2026-09-18T21:05:50.406Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-18T21:06:20.191" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:50.391" grpc.time_ms=14.254 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821'1772gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821', in 0.04 seconds)1773gitlab # [ 241.369697] nixbot[2634]: INFO: ::ffff:127.0.0.1:57214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 200 OK1774gitlab # [ 241.504502] gitaly[904]: time="2026-09-18T21:05:50.791Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-18T21:06:00.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:50.790" grpc.time_ms=1.054 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 241.536405] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:50.821Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 79f342e778e69e791392ca7ab634b2ccb8669e2c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d5b278ec5fb573501f75a31a","created_at":"2026-09-18T21:05:04.747Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-c63109026c7b4762","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:05:04.768Z","job_size_bytes":185,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d5b278ec5fb573501f75a31a: done: 0.860262 sec","job_status":"done","queue_duration_s":45.193087,"scheduling_latency_s":45.193101,"gitaly_calls":13,"gitaly_duration_s":0.250608,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.047045,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.004644,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006364,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001453,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003479,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.017616,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.013489,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.18,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.2,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.493751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000446146,"exclusive_lock_hold_duration_s":0.024009475,"duration_s":0.860262,"completed_at":"2026-09-18T21:05:50.821Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092063,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1776gitlab # [ 241.599090] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:50.824Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e5aee3044355b137428d799c","created_at":"2026-09-18T21:05:09.033Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.042Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e5aee3044355b137428d799c: start","job_status":"start","queue_duration_s":41.781365,"scheduling_latency_s":41.781398}1777gitlab # [ 241.613415] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:50.900Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e5aee3044355b137428d799c","created_at":"2026-09-18T21:05:09.033Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.042Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e5aee3044355b137428d799c: done: 0.076079 sec","job_status":"done","queue_duration_s":41.781365,"scheduling_latency_s":41.781398,"redis_calls":16,"redis_duration_s":0.002901,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001434,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002288,"duration_s":0.076079,"completed_at":"2026-09-18T21:05:50.900Z","load_balancing_strategy":"primary","db_duration_s":0.011837,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1778gitlab # [ 241.620732] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:50.901Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"51fdcc702b7af1593e99e323","created_at":"2026-09-18T21:05:09.043Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.050Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-51fdcc702b7af1593e99e323: start","job_status":"start","queue_duration_s":41.850702,"scheduling_latency_s":41.850717}1779gitlab # [ 241.669888] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:50.956Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"51fdcc702b7af1593e99e323","created_at":"2026-09-18T21:05:09.043Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.050Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-51fdcc702b7af1593e99e323: done: 0.055353 sec","job_status":"done","queue_duration_s":41.850702,"scheduling_latency_s":41.850717,"redis_calls":21,"redis_duration_s":0.002759,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001217,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234946,"duration_s":0.055353,"completed_at":"2026-09-18T21:05:50.956Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1780gitlab # [ 241.678077] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:50.957Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0803b0f2e882976966b72af3","created_at":"2026-09-18T21:05:09.152Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.157Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0803b0f2e882976966b72af3: start","job_status":"start","queue_duration_s":41.800598,"scheduling_latency_s":41.800613}1781gitlab # [ 241.838676] gitaly[904]: time="2026-09-18T21:05:51.124Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:51.123" grpc.time_ms=0.966 pid=904 span.kind=server system=grpc1782gitlab # [ 241.881661] gitaly[904]: time="2026-09-18T21:05:51.168Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:51.168" grpc.time_ms=0.375 pid=904 span.kind=server system=grpc1783gitlab # [ 241.936558] gitaly[904]: time="2026-09-18T21:05:51.223Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:51.223" grpc.time_ms=0.377 pid=904 span.kind=server system=grpc1784gitlab # [ 241.958524] gitaly[904]: time="2026-09-18T21:05:51.245Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 diskcache=6810685f-02ef-4b21-935b-88a15a5496aa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:21.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.095" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 241.959238] gitaly[904]: time="2026-09-18T21:05:51.245Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=141 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7407 command.oublock=0 command.real_time_ms=142 command.spawn_token_fork_ms=0 command.system_time_ms=94 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:21.095" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.095" grpc.time_ms=150.155 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 242.043960] gitaly[904]: time="2026-09-18T21:05:51.330Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:21.328" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.329" grpc.time_ms=1.294 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 242.072677] gitaly[904]: time="2026-09-18T21:05:51.359Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CQF1TVT4J8TXRMDY8KN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:21.357" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.358" grpc.time_ms=0.968 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 242.109524] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.395Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0803b0f2e882976966b72af3","created_at":"2026-09-18T21:05:09.152Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.157Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2512,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0803b0f2e882976966b72af3: rescheduled"}1789gitlab # [ 242.122246] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.408Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0803b0f2e882976966b72af3","created_at":"2026-09-18T21:05:09.152Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-e60de5a1847742b6","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:09.157Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0803b0f2e882976966b72af3: done: 0.450912 sec","job_status":"done","queue_duration_s":41.800598,"scheduling_latency_s":41.800613,"gitaly_calls":3,"gitaly_duration_s":0.179132,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.023636,"redis_read_bytes":460,"redis_write_bytes":29296,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000726,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001061,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.008461,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.00387,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005322,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000433,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000587,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00245,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.210515,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.40268665400000003,"duration_s":0.450912,"completed_at":"2026-09-18T21:05:51.408Z","load_balancing_strategy":"primary","db_duration_s":0.055809,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1790gitlab # [ 242.142216] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.410Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","79f342e778e69e791392ca7ab634b2ccb8669e2c 82a45f0a3c3fbe4f40a60e728b189fd0358ec821 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"95ea706602f2a82837910255","created_at":"2026-09-18T21:05:49.415Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-d33b48c82ed74866","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:05:49.417Z","job_size_bytes":185,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-95ea706602f2a82837910255: start","job_status":"start","queue_duration_s":1.993095,"scheduling_latency_s":1.993129}1791gitlab # [ 242.158137] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.424Z","message":"changes: \"79f342e778e69e791392ca7ab634b2ccb8669e2c 82a45f0a3c3fbe4f40a60e728b189fd0358ec821 refs/heads/master\\n\""}1792gitlab # [ 242.161332] gitaly[904]: time="2026-09-18T21:05:51.448Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:01.131" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.441" grpc.time_ms=6.399 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 242.173038] gitaly[904]: time="2026-09-18T21:05:51.455Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-18T21:06:01.140" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:51.450" grpc.time_ms=4.157 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 242.185308] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.457Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3b73684649e19f669e179ba4","created_at":"2026-09-18T21:05:51.456Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"27819cf7e05afdbc0734c064","job_size_bytes":46,"pid":2512,"job_status":"deduplicated","message":"ProjectCacheWorker JID-3b73684649e19f669e179ba4: deduplicated: until executing","deduplication.type":"until executing"}1795gitlab # [ 242.199255] gitaly[904]: time="2026-09-18T21:05:51.469Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-18T21:06:01.154" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.464" grpc.time_ms=4.342 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 242.245478] gitaly[904]: time="2026-09-18T21:05:51.476Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-18T21:06:21.471" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.471" grpc.time_ms=4.876 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 242.246240] gitaly[904]: time="2026-09-18T21:05:51.484Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-18T21:06:01.171" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-18T21:05:51.481" grpc.time_ms=2.769 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 242.246819] gitaly[904]: time="2026-09-18T21:05:51.498Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:01.182" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.492" grpc.time_ms=6.387 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 242.272908] gitaly[904]: time="2026-09-18T21:05:51.559Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-18T21:06:01.248" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.558" grpc.time_ms=1.07 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 242.286284] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.572Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","79f342e778e69e791392ca7ab634b2ccb8669e2c 82a45f0a3c3fbe4f40a60e728b189fd0358ec821 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"95ea706602f2a82837910255","created_at":"2026-09-18T21:05:49.415Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-d33b48c82ed74866","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-18T21:05:49.417Z","job_size_bytes":185,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-95ea706602f2a82837910255: done: 0.162574 sec","job_status":"done","queue_duration_s":1.993095,"scheduling_latency_s":1.993129,"gitaly_calls":7,"gitaly_duration_s":0.040444,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.015158999999999999,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001616,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000681,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002388,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005017,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005457,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000587504,"exclusive_lock_hold_duration_s":0.014423062,"duration_s":0.162574,"completed_at":"2026-09-18T21:05:51.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016163,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1801gitlab # [ 242.329762] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.574Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"27819cf7e05afdbc0734c064","created_at":"2026-09-18T21:05:50.013Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.026Z","job_size_bytes":46,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-27819cf7e05afdbc0734c064: start","job_status":"start","queue_duration_s":1.547331,"scheduling_latency_s":1.547349}1802gitlab # [ 242.330721] gitaly[904]: time="2026-09-18T21:05:51.605Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-19T03:05:51.602" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:51.603" grpc.time_ms=2.393 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821'1804gitlab # [ 242.331515] gitaly[904]: time="2026-09-18T21:05:51.616Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-18T21:06:21.610" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.610" grpc.time_ms=5.945 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821', in 0.03 seconds)1806gitlab # [ 242.374649] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.635Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"27819cf7e05afdbc0734c064","created_at":"2026-09-18T21:05:50.013Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.026Z","job_size_bytes":46,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-27819cf7e05afdbc0734c064: done: 0.060904 sec","job_status":"done","queue_duration_s":1.547331,"scheduling_latency_s":1.547349,"gitaly_calls":2,"gitaly_duration_s":0.011722,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004565,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000879,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000411,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001833,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208686,"duration_s":0.060904,"completed_at":"2026-09-18T21:05:51.634Z","load_balancing_strategy":"primary","db_duration_s":0.008304,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1807gitlab # [ 242.422863] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.636Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b1c4b32cbff010681f38937d","created_at":"2026-09-18T21:05:50.038Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.041Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b1c4b32cbff010681f38937d: start","job_status":"start","queue_duration_s":1.594143,"scheduling_latency_s":1.594186}1808gitlab # [ 242.423802] gitaly[904]: time="2026-09-18T21:05:51.677Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 diskcache=cc634f79-f53a-4e86-be10-de4415e6af34 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T03:05:51.650" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.651" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 242.424882] nixbot[2634]: INFO: ::ffff:127.0.0.1:57216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 200 OK1810gitlab # [ 242.425572] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.707Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b1c4b32cbff010681f38937d","created_at":"2026-09-18T21:05:50.038Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.041Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b1c4b32cbff010681f38937d: done: 0.071505 sec","job_status":"done","queue_duration_s":1.594143,"scheduling_latency_s":1.594186,"gitaly_calls":1,"gitaly_duration_s":0.027993,"redis_calls":15,"redis_duration_s":0.002408,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000388,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.055436375,"duration_s":0.071505,"completed_at":"2026-09-18T21:05:51.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1811gitlab # [ 242.456324] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.708Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ebe470bdfc1a6c8f1f5c445d","created_at":"2026-09-18T21:05:50.195Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.196Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ebe470bdfc1a6c8f1f5c445d: start","job_status":"start","queue_duration_s":1.511965,"scheduling_latency_s":1.511979}1812gitlab # [ 242.470805] gitaly[904]: time="2026-09-18T21:05:51.677Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T03:05:51.650" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.651" grpc.time_ms=26.075 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 242.484836] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.739Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ebe470bdfc1a6c8f1f5c445d","created_at":"2026-09-18T21:05:50.195Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.196Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ebe470bdfc1a6c8f1f5c445d: done: 0.03047 sec","job_status":"done","queue_duration_s":1.511965,"scheduling_latency_s":1.511979,"gitaly_calls":1,"gitaly_duration_s":0.007613,"redis_calls":16,"redis_duration_s":0.002673,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000202,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001038,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03047,"completed_at":"2026-09-18T21:05:51.739Z","load_balancing_strategy":"primary","db_duration_s":0.001728,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1814gitlab # [ 242.526792] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:51.740Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"514af55f5634cda580f9a859","created_at":"2026-09-18T21:05:50.659Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:12c454b68cf77019d1253a701709a358fa80d69b3a57e37ee695a35e2b1573ee","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.666Z","job_size_bytes":467,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-514af55f5634cda580f9a859: start","job_status":"start","queue_duration_s":1.073833,"scheduling_latency_s":1.07385}1815gitlab # [ 242.567826] gitaly[904]: time="2026-09-18T21:05:51.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-18T21:06:21.726" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.726" grpc.time_ms=5.899 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 242.568713] gitaly[904]: time="2026-09-18T21:05:51.758Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:21.757" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.757" grpc.time_ms=0.536 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 242.569531] gitaly[904]: time="2026-09-18T21:05:51.766Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T21:06:01.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.760" grpc.time_ms=6.032 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 242.576755] gitaly[904]: time="2026-09-18T21:05:51.850Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:21.849" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.849" grpc.time_ms=0.826 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 242.588841] gitaly[904]: time="2026-09-18T21:05:51.857Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-18T21:06:21.853" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:51.853" grpc.time_ms=3.673 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 242.646611] gitaly[904]: time="2026-09-18T21:05:51.933Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=16 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:01.160" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:51.911" grpc.time_ms=22.321 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 243.065604] gitaly[904]: time="2026-09-18T21:05:52.351Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-18T21:06:22.335" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:52.336" grpc.time_ms=15.491 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 243.091176] gitaly[904]: time="2026-09-18T21:05:52.378Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2V5CK3593T4K2KA4TDPEKW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-18T21:06:22.368" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:52.368" grpc.time_ms=8.87 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 243.122718] sidekiq-cluster[2512]: {"severity":"WARN","time":"2026-09-18T21:05:52.408Z","class":"CreatePipelineWorker","correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"79f342e778e69e791392ca7ab634b2ccb8669e2c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"79f342e778e69e791392ca7ab634b2ccb8669e2c","ref":"refs/heads/master"},"retry":0}1824gitlab # [ 243.132825] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.418Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"514af55f5634cda580f9a859","created_at":"2026-09-18T21:05:50.659Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:12c454b68cf77019d1253a701709a358fa80d69b3a57e37ee695a35e2b1573ee","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.666Z","job_size_bytes":467,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-514af55f5634cda580f9a859: done: 0.678024 sec","job_status":"done","queue_duration_s":1.073833,"scheduling_latency_s":1.07385,"gitaly_calls":7,"gitaly_duration_s":0.086329,"redis_calls":51,"redis_duration_s":0.008863,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000661,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003704,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002063,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001299,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.545814,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000456204,"duration_s":0.678024,"completed_at":"2026-09-18T21:05:52.418Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1825gitlab # [ 243.137843] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.421Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"59ab93c3-ab7d-4a3b-90ff-3ff3de0f1008\"}"],"class":"WebHookWorker","jid":"6241553761385ddd2becd24f","created_at":"2026-09-18T21:05:50.767Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:675c36d24dc2c5411e54202ae77ae39463e90ca78788993daa034d32f6f9960a","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.771Z","job_size_bytes":1751,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-6241553761385ddd2becd24f: start","job_status":"start","queue_duration_s":1.649616,"scheduling_latency_s":1.649649}1826gitlab # [ 243.263399] nixbot[2634]: INFO: ::ffff:127.0.0.1:50854 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1827gitlab # [ 243.290203] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.576Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"59ab93c3-ab7d-4a3b-90ff-3ff3de0f1008\"}"],"class":"WebHookWorker","jid":"6241553761385ddd2becd24f","created_at":"2026-09-18T21:05:50.767Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-22c64f99aa904fa0","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:675c36d24dc2c5411e54202ae77ae39463e90ca78788993daa034d32f6f9960a","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:50.771Z","job_size_bytes":1751,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-6241553761385ddd2becd24f: done: 0.155319 sec","job_status":"done","queue_duration_s":1.649616,"scheduling_latency_s":1.649649,"redis_calls":19,"redis_duration_s":0.005407,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001277,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.001244,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002006,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05890748699999904,"cpu_s":0.078381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000423518,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.155319,"completed_at":"2026-09-18T21:05:52.576Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # [ 243.299615] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d8ea9a90736f804056d2f8a0","created_at":"2026-09-18T21:05:51.086Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.088Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d8ea9a90736f804056d2f8a0: start","job_status":"start","queue_duration_s":1.489256,"scheduling_latency_s":1.489274}1829gitlab # [ 243.353606] gitaly[904]: time="2026-09-18T21:05:52.640Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E2EGN5RNJP8MMPCN3MN3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.633" grpc.time_ms=6.512 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 243.355150] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 481831gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821'1832gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821', in 0.03 seconds)1833gitlab # [ 243.364926] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d8ea9a90736f804056d2f8a0","created_at":"2026-09-18T21:05:51.086Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.088Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d8ea9a90736f804056d2f8a0: done: 0.0735 sec","job_status":"done","queue_duration_s":1.489256,"scheduling_latency_s":1.489274,"redis_calls":10,"redis_duration_s":0.006817,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000355911,"duration_s":0.0735,"completed_at":"2026-09-18T21:05:52.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014868,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1834gitlab # [ 243.392120] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.652Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d0660d3e92ddbdbb3d338e5a","created_at":"2026-09-18T21:05:51.251Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.255Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d0660d3e92ddbdbb3d338e5a: start","job_status":"start","queue_duration_s":1.397471,"scheduling_latency_s":1.397485}1835gitlab # [ 243.440423] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.675Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d0660d3e92ddbdbb3d338e5a","created_at":"2026-09-18T21:05:51.251Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.255Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d0660d3e92ddbdbb3d338e5a: done: 0.023116 sec","job_status":"done","queue_duration_s":1.397471,"scheduling_latency_s":1.397485,"redis_calls":10,"redis_duration_s":0.003426,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001017,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000331047,"duration_s":0.023116,"completed_at":"2026-09-18T21:05:52.675Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1836gitlab # [ 243.446775] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"93d7d14655f8a37b365d6afc","created_at":"2026-09-18T21:05:51.264Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.269Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-93d7d14655f8a37b365d6afc: start","job_status":"start","queue_duration_s":1.407293,"scheduling_latency_s":1.407306}1837gitlab # [ 243.461846] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.704Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"93d7d14655f8a37b365d6afc","created_at":"2026-09-18T21:05:51.264Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.269Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-93d7d14655f8a37b365d6afc: done: 0.027567 sec","job_status":"done","queue_duration_s":1.407293,"scheduling_latency_s":1.407306,"redis_calls":10,"redis_duration_s":0.0022630000000000003,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243327,"duration_s":0.027567,"completed_at":"2026-09-18T21:05:52.704Z","load_balancing_strategy":"primary","db_duration_s":0.007103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 243.523332] nixbot[2634]: INFO: ::ffff:127.0.0.1:50864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 200 OK1839gitlab # [ 243.523945] gitaly[904]: time="2026-09-18T21:05:52.689Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E2G3Y8VBMMKWF5GM50VN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.681" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1840gitlab # [ 243.524618] gitlab-workhorse[823]: time="2026-09-18T21:05:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671841gitlab # [ 243.525091] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 461842gitlab # [ 243.525605] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.705Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"51450d4a7ce82e43bf706bdf","created_at":"2026-09-18T21:05:51.281Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.284Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-51450d4a7ce82e43bf706bdf: start","job_status":"start","queue_duration_s":1.421444,"scheduling_latency_s":1.421457}1843gitlab # [ 243.529574] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.730Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"51450d4a7ce82e43bf706bdf","created_at":"2026-09-18T21:05:51.281Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.284Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-51450d4a7ce82e43bf706bdf: done: 0.024924 sec","job_status":"done","queue_duration_s":1.421444,"scheduling_latency_s":1.421457,"redis_calls":13,"redis_duration_s":0.001997,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00036,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000465423,"duration_s":0.024924,"completed_at":"2026-09-18T21:05:52.730Z","load_balancing_strategy":"primary","db_duration_s":0.004229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1844gitlab # [ 243.571778] gitaly[904]: time="2026-09-18T21:05:52.689Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E2G3Y8VBMMKWF5GM50VN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.681" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1845gitlab # [ 243.584102] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c097b2c1f2144a94af71f0c2","created_at":"2026-09-18T21:05:51.284Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.287Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c097b2c1f2144a94af71f0c2: start","job_status":"start","queue_duration_s":1.446013,"scheduling_latency_s":1.446028}1846gitlab # [ 243.599502] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c097b2c1f2144a94af71f0c2","created_at":"2026-09-18T21:05:51.284Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.287Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c097b2c1f2144a94af71f0c2: done: 0.021275 sec","job_status":"done","queue_duration_s":1.446013,"scheduling_latency_s":1.446028,"redis_calls":10,"redis_duration_s":0.001887,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215949,"duration_s":0.021275,"completed_at":"2026-09-18T21:05:52.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1847gitlab # [ 243.675937] gitaly[904]: time="2026-09-18T21:05:52.689Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E2G3Y8VBMMKWF5GM50VN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.681" grpc.time_ms=7.711 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1848gitlab # [ 243.676687] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"32fdff4f58b0aa2d03b52629","created_at":"2026-09-18T21:05:51.287Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.291Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-32fdff4f58b0aa2d03b52629: start","job_status":"start","queue_duration_s":1.464585,"scheduling_latency_s":1.464598}1849gitlab # [ 243.677455] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"32fdff4f58b0aa2d03b52629","created_at":"2026-09-18T21:05:51.287Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.291Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-32fdff4f58b0aa2d03b52629: done: 0.018301 sec","job_status":"done","queue_duration_s":1.464585,"scheduling_latency_s":1.464598,"redis_calls":11,"redis_duration_s":0.0017599999999999998,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209524,"duration_s":0.018301,"completed_at":"2026-09-18T21:05:52.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 243.717246] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.774Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b3e1d4534d1ba4c18b91d5ad","created_at":"2026-09-18T21:05:51.293Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.295Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b3e1d4534d1ba4c18b91d5ad: start","job_status":"start","queue_duration_s":1.478917,"scheduling_latency_s":1.47893}1851gitlab # [ 243.721050] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.798Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b3e1d4534d1ba4c18b91d5ad","created_at":"2026-09-18T21:05:51.293Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.295Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b3e1d4534d1ba4c18b91d5ad: done: 0.02389 sec","job_status":"done","queue_duration_s":1.478917,"scheduling_latency_s":1.47893,"redis_calls":10,"redis_duration_s":0.00152,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000250869,"duration_s":0.02389,"completed_at":"2026-09-18T21:05:52.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab # [ 243.767721] gitaly[904]: time="2026-09-18T21:05:52.972Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT diskcache=fc3f2199-a154-46dd-9d4f-cdfd6590328a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T03:05:52.961" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:52.961" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 243.768521] gitaly[904]: time="2026-09-18T21:05:52.972Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-19T03:05:52.961" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:52.961" grpc.time_ms=10.889 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 243.779776] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8acddef30754d047267f5157","created_at":"2026-09-18T21:05:51.296Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.299Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8acddef30754d047267f5157: start","job_status":"start","queue_duration_s":1.500312,"scheduling_latency_s":1.500328}1855gitlab # [ 243.793858] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8acddef30754d047267f5157","created_at":"2026-09-18T21:05:51.296Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.299Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8acddef30754d047267f5157: done: 0.025827 sec","job_status":"done","queue_duration_s":1.500312,"scheduling_latency_s":1.500328,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023327,"duration_s":0.025827,"completed_at":"2026-09-18T21:05:52.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 243.851227] gitaly[904]: time="2026-09-18T21:05:52.997Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:22.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:52.996" grpc.time_ms=0.572 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 243.851888] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.826Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3cb84921a29d7a81d262de54","created_at":"2026-09-18T21:05:51.304Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.307Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3cb84921a29d7a81d262de54: start","job_status":"start","queue_duration_s":1.519634,"scheduling_latency_s":1.51965}1858gitlab # [ 243.856147] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.849Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3cb84921a29d7a81d262de54","created_at":"2026-09-18T21:05:51.304Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.307Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3cb84921a29d7a81d262de54: done: 0.023039 sec","job_status":"done","queue_duration_s":1.519634,"scheduling_latency_s":1.51965,"redis_calls":10,"redis_duration_s":0.001373,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235784,"duration_s":0.023039,"completed_at":"2026-09-18T21:05:52.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1859gitlab # [ 243.924821] gitaly[904]: time="2026-09-18T21:05:53.005Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T21:06:02.248" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:52.999" grpc.time_ms=5.93 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 243.925590] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f88b193c8331ad53dc038fb9","created_at":"2026-09-18T21:05:51.307Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.310Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f88b193c8331ad53dc038fb9: start","job_status":"start","queue_duration_s":1.540639,"scheduling_latency_s":1.540654}1861gitlab # [ 243.926235] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f88b193c8331ad53dc038fb9","created_at":"2026-09-18T21:05:51.307Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.310Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f88b193c8331ad53dc038fb9: done: 0.014405 sec","job_status":"done","queue_duration_s":1.540639,"scheduling_latency_s":1.540654,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238858,"duration_s":0.014405,"completed_at":"2026-09-18T21:05:52.865Z","load_balancing_strategy":"primary","db_duration_s":0.00134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1862gitlab # [ 243.958143] gitaly[904]: time="2026-09-18T21:05:53.030Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:23.029" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:53.029" grpc.time_ms=0.622 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 244.004111] gitlab-workhorse[823]: time="2026-09-18T21:05:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3411864gitlab # [ 244.004726] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 341 "" "git/2.55.0" 5381865gitlab # [ 244.005267] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"95138de11e94f29482da9c3d","created_at":"2026-09-18T21:05:51.310Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.313Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-95138de11e94f29482da9c3d: start","job_status":"start","queue_duration_s":1.552907,"scheduling_latency_s":1.552922}1866gitlab # [ 244.005847] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"95138de11e94f29482da9c3d","created_at":"2026-09-18T21:05:51.310Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.313Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-95138de11e94f29482da9c3d: done: 0.02182 sec","job_status":"done","queue_duration_s":1.552907,"scheduling_latency_s":1.552922,"redis_calls":10,"redis_duration_s":0.001338,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222375,"duration_s":0.02182,"completed_at":"2026-09-18T21:05:52.887Z","load_balancing_strategy":"primary","db_duration_s":0.003905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 244.048713] gitaly[904]: time="2026-09-18T21:05:53.035Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=222 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-18T21:06:23.032" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:53.033" grpc.time_ms=2.636 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 244.049608] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.888Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"560bde783eb6a39378f168ca","created_at":"2026-09-18T21:05:51.317Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.320Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-560bde783eb6a39378f168ca: start","job_status":"start","queue_duration_s":1.568205,"scheduling_latency_s":1.568219}1869gitlab # [ 244.050680] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"560bde783eb6a39378f168ca","created_at":"2026-09-18T21:05:51.317Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.320Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-560bde783eb6a39378f168ca: done: 0.041146 sec","job_status":"done","queue_duration_s":1.568205,"scheduling_latency_s":1.568219,"redis_calls":14,"redis_duration_s":0.002062,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253664,"duration_s":0.041146,"completed_at":"2026-09-18T21:05:52.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1870gitlab # [ 244.093196] gitaly[904]: time="2026-09-18T21:05:53.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:03.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:53.052" grpc.time_ms=6.965 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 244.100111] gitaly[904]: time="2026-09-18T21:05:53.229Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E2HKX7JN8R1953WEMYGF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.734" pid=904 remote_ip="2001:db8:1::1" request_sha=44cb6f982afa20af2c601fa53bc25c999c7def3c response_bytes=341 span.kind=server system=grpc1872gitlab # [ 244.109128] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.931Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f3f2a1b4b0117555ae26edf7","created_at":"2026-09-18T21:05:51.396Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.398Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f3f2a1b4b0117555ae26edf7: start","job_status":"start","queue_duration_s":1.532127,"scheduling_latency_s":1.532142}1873gitlab # [ 244.123746] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.949Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f3f2a1b4b0117555ae26edf7","created_at":"2026-09-18T21:05:51.396Z","trace_propagation_headers":{"sentry-trace":"5c496a20b0ed47759336534c664ea057-421b591fcfee42d1","baggage":"sentry-trace_id=5c496a20b0ed47759336534c664ea057,sentry-release=Unknown"},"correlation_id":"01M2V5CQF1TVT4J8TXRMDY8KN9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.398Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f3f2a1b4b0117555ae26edf7: done: 0.018346 sec","job_status":"done","queue_duration_s":1.532127,"scheduling_latency_s":1.532142,"redis_calls":8,"redis_duration_s":0.0010400000000000001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018346,"completed_at":"2026-09-18T21:05:52.949Z","load_balancing_strategy":"primary","db_duration_s":0.002695,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1874gitlab # [ 244.166873] gitaly[904]: time="2026-09-18T21:05:53.229Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=492 command.spawn_token_fork_ms=483 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E2HKX7JN8R1953WEMYGF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.734" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1875gitlab # [ 244.174880] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.950Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"40d5853c86d90226a3442ce9","created_at":"2026-09-18T21:05:51.461Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"b1c4b32cbff010681f38937d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.462Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-40d5853c86d90226a3442ce9: start","job_status":"start","queue_duration_s":1.487926,"scheduling_latency_s":1.487941}1876gitlab # [ 244.189553] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.982Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"40d5853c86d90226a3442ce9","created_at":"2026-09-18T21:05:51.461Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"b1c4b32cbff010681f38937d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.462Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-40d5853c86d90226a3442ce9: done: 0.031893 sec","job_status":"done","queue_duration_s":1.487926,"scheduling_latency_s":1.487941,"gitaly_calls":1,"gitaly_duration_s":0.012819,"redis_calls":12,"redis_duration_s":0.001725,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.020840358,"duration_s":0.031893,"completed_at":"2026-09-18T21:05:52.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 244.234856] gitaly[904]: time="2026-09-18T21:05:53.229Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=492 command.spawn_token_fork_ms=483 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E2HKX7JN8R1953WEMYGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:52.734" grpc.time_ms=495.295 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1878gitlab # [ 244.244796] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:52.983Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"13d890885cf0f7f165a79f70","created_at":"2026-09-18T21:05:51.535Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2c8323d70da4bd822c7b75c6a7ea6c837f87d750d39705244535d30233935ddc","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.538Z","job_size_bytes":467,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-13d890885cf0f7f165a79f70: start","job_status":"start","queue_duration_s":1.444997,"scheduling_latency_s":1.445011}1879gitlab # [ 244.260717] sidekiq-cluster[2512]: {"severity":"WARN","time":"2026-09-18T21:05:53.443Z","class":"CreatePipelineWorker","correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"79f342e778e69e791392ca7ab634b2ccb8669e2c","after":"82a45f0a3c3fbe4f40a60e728b189fd0358ec821","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"82a45f0a3c3fbe4f40a60e728b189fd0358ec821","ref":"refs/heads/master"},"retry":0}1880gitlab # [ 244.267712] nixbot[2634]: {"ts": "2026-09-18T21:05:53.522Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1881gitlab # [ 244.269890] gitaly[904]: time="2026-09-18T21:05:53.421Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-18T21:06:23.412" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:53.413" grpc.time_ms=8.539 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 244.316760] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.447Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"13d890885cf0f7f165a79f70","created_at":"2026-09-18T21:05:51.535Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2c8323d70da4bd822c7b75c6a7ea6c837f87d750d39705244535d30233935ddc","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.538Z","job_size_bytes":467,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-13d890885cf0f7f165a79f70: done: 0.464724 sec","job_status":"done","queue_duration_s":1.444997,"scheduling_latency_s":1.445011,"gitaly_calls":7,"gitaly_duration_s":0.046263,"redis_calls":33,"redis_duration_s":0.003612,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000429,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001721,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.398384,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.464724,"completed_at":"2026-09-18T21:05:53.447Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013744,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1883gitlab # [ 244.326785] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.449Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"fdc7dea5-c8c2-4f3d-a434-03190ee58656\"}"],"class":"WebHookWorker","jid":"bd3f3779fe77c7c58b3ccdfe","created_at":"2026-09-18T21:05:51.549Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:26173470f8cca13d02a0071c0ec84d0cd832477c3bfb5b8d43252ab3aecfec9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.550Z","job_size_bytes":1749,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bd3f3779fe77c7c58b3ccdfe: start","job_status":"start","queue_duration_s":1.898523,"scheduling_latency_s":1.898541}1884gitlab # [ 244.342738] gitaly[904]: time="2026-09-18T21:05:53.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5DYZR3CBQ6PK8KNKVEHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-18T21:06:23.423" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:53.423" grpc.time_ms=8.651 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 244.354916] gitaly[904]: time="2026-09-18T21:05:53.569Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:23.568" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:53.568" grpc.time_ms=0.5 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 244.366717] gitaly[904]: time="2026-09-18T21:05:53.618Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:03.192" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:53.612" grpc.time_ms=5.778 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 244.421721] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1221888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821'1889gitlab # [ 244.422160] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.677Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"fdc7dea5-c8c2-4f3d-a434-03190ee58656\"}"],"class":"WebHookWorker","jid":"bd3f3779fe77c7c58b3ccdfe","created_at":"2026-09-18T21:05:51.549Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-1f139a04e72344b6","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:26173470f8cca13d02a0071c0ec84d0cd832477c3bfb5b8d43252ab3aecfec9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.550Z","job_size_bytes":1749,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bd3f3779fe77c7c58b3ccdfe: done: 0.228715 sec","job_status":"done","queue_duration_s":1.898523,"scheduling_latency_s":1.898541,"redis_calls":14,"redis_duration_s":0.008882,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000269,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002496,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.006117,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005799620000004779,"cpu_s":0.023686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.228715,"completed_at":"2026-09-18T21:05:53.677Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821', in 0.04 seconds)1891gitlab # [ 244.426896] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"397379550fdb0426dc644c67","created_at":"2026-09-18T21:05:51.624Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-367970d87c57489f","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.627Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-397379550fdb0426dc644c67: start","job_status":"start","queue_duration_s":2.052086,"scheduling_latency_s":2.05211}1892gitlab # [ 244.440582] nixbot[2634]: {"ts": "2026-09-18T21:05:53.655Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1893gitlab # [ 244.442720] nixbot[2634]: INFO: ::ffff:127.0.0.1:50878 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1894gitlab # [ 244.443791] gitaly[904]: time="2026-09-18T21:05:53.714Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3FT2NQJEDKA8R56E3KX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:23.213" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:53.713" grpc.time_ms=0.675 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895gitlab # [ 244.488872] nixbot[2634]: INFO: ::ffff:127.0.0.1:50884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 200 OK1896gitlab # [ 244.513181] gitaly[904]: time="2026-09-18T21:05:53.800Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3GR3N8YJM3DPH9ATR8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:53.793" grpc.time_ms=6.395 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 244.513743] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1111898gitlab # [ 244.526247] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"397379550fdb0426dc644c67","created_at":"2026-09-18T21:05:51.624Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-367970d87c57489f","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:51.627Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-397379550fdb0426dc644c67: done: 0.132967 sec","job_status":"done","queue_duration_s":2.052086,"scheduling_latency_s":2.05211,"redis_calls":19,"redis_duration_s":0.08514999999999999,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001041,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00048,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.010922,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.072707,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011617119,"duration_s":0.132967,"completed_at":"2026-09-18T21:05:53.812Z","load_balancing_strategy":"primary","db_duration_s":0.00614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 244.528503] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.815Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","6241553761385ddd2becd24f"],"class":"WebHooks::LogExecutionWorker","jid":"a9d2e6489f41c9641e2bce5e","created_at":"2026-09-18T21:05:52.554Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-4f3ee535c6b84cfe","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2cbeb5b708a94ada1a27b71ff56f82124db66916da09b5a5cd813b4492f930f2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:52.566Z","job_size_bytes":2593,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a9d2e6489f41c9641e2bce5e: start","job_status":"start","queue_duration_s":1.248884,"scheduling_latency_s":1.248902}1900gitlab # [ 244.565116] gitaly[904]: time="2026-09-18T21:05:53.852Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3M92HJQJGTQK7HGBCTJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:53.844" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1901gitlab # [ 244.565920] gitaly[904]: time="2026-09-18T21:05:53.852Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3M92HJQJGTQK7HGBCTJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:53.844" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1902gitlab # [ 244.566772] gitlab-workhorse[823]: time="2026-09-18T21:05:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671903gitlab # [ 244.567463] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 501904gitlab # [ 244.567963] gitaly[904]: time="2026-09-18T21:05:53.852Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3M92HJQJGTQK7HGBCTJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:53.844" grpc.time_ms=8.088 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 244.580185] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.866Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","6241553761385ddd2becd24f"],"class":"WebHooks::LogExecutionWorker","jid":"a9d2e6489f41c9641e2bce5e","created_at":"2026-09-18T21:05:52.554Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-4f3ee535c6b84cfe","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2cbeb5b708a94ada1a27b71ff56f82124db66916da09b5a5cd813b4492f930f2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:52.566Z","job_size_bytes":2593,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a9d2e6489f41c9641e2bce5e: done: 0.05104 sec","job_status":"done","queue_duration_s":1.248884,"scheduling_latency_s":1.248902,"redis_calls":10,"redis_duration_s":0.0042450000000000005,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000260647,"duration_s":0.05104,"completed_at":"2026-09-18T21:05:53.866Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1906gitlab # [ 244.631138] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:53.867Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c87a6d7bdcbd19363e181ed","created_at":"2026-09-18T21:05:53.641Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f77cb9c486ac48c6","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.643Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c87a6d7bdcbd19363e181ed: start","job_status":"start","queue_duration_s":0.224082,"scheduling_latency_s":0.224097}1907gitlab # [ 244.663117] gitaly[904]: time="2026-09-18T21:05:53.950Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3Q2VCZQ6K6FY454Z1PZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:53.942" grpc.time_ms=7.179 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1908gitlab # [ 244.664560] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 591909gitlab # [ 244.727545] gitaly[904]: time="2026-09-18T21:05:54.014Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:54.013" grpc.time_ms=0.287 pid=904 span.kind=server system=grpc1910gitlab # [ 244.728687] gitaly[904]: time="2026-09-18T21:05:54.014Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3S02BACTEZ93GBJBZYQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.001" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1911gitlab # [ 244.745144] gitaly[904]: time="2026-09-18T21:05:54.031Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3S02BACTEZ93GBJBZYQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.001" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 244.757362] gitaly[904]: time="2026-09-18T21:05:54.044Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3S02BACTEZ93GBJBZYQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.001" grpc.time_ms=30.982 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1913gitlab # [ 244.771226] gitlab-workhorse[823]: time="2026-09-18T21:05:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671914gitlab # [ 244.772809] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1051915gitlab # [ 244.776672] gitaly[904]: time="2026-09-18T21:05:54.062Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3FT2NQJEDKA8R56E3KX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:04.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:54.043" grpc.time_ms=18.987 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 244.792047] gitaly[904]: time="2026-09-18T21:05:54.079Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:54.077" grpc.time_ms=0.482 pid=904 span.kind=server system=grpc1917gitlab # [ 244.823364] gitaly[904]: time="2026-09-18T21:05:54.110Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:54.109" grpc.time_ms=0.395 pid=904 span.kind=server system=grpc1918gitlab # [ 244.842627] gitaly[904]: time="2026-09-18T21:05:54.129Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB diskcache=a2fc894f-2c10-48d3-bd08-72dd9fa6e116 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:23.082" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:53.983" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 244.842825] gitaly[904]: time="2026-09-18T21:05:54.129Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7289 command.oublock=0 command.real_time_ms=135 command.spawn_token_fork_ms=2 command.system_time_ms=71 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:23.082" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:53.983" grpc.time_ms=145.814 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 244.852082] gitaly[904]: time="2026-09-18T21:05:54.138Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3X99P5J7553MFVZAQGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.131" grpc.time_ms=6.959 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1921gitlab # [ 244.852958] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491922gitlab # [ 244.867691] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4961923gitlab # [ 244.870075] nixbot[2634]: {"ts": "2026-09-18T21:05:54.156Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1924gitlab # [ 244.918985] gitaly[904]: time="2026-09-18T21:05:54.205Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3YW1TW2EAEQ0N09PB6G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.188" pid=904 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1925gitlab # [ 244.919260] gitaly[904]: time="2026-09-18T21:05:54.205Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3YW1TW2EAEQ0N09PB6G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.188" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1926gitlab # [ 244.919834] gitaly[904]: time="2026-09-18T21:05:54.206Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3YW1TW2EAEQ0N09PB6G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:05:54.188" grpc.time_ms=17.91 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927gitlab # [ 244.921493] gitlab-workhorse[823]: time="2026-09-18T21:05:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161928gitlab # [ 244.922237] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 671929gitlab # [ 244.959630] gitaly[904]: time="2026-09-18T21:05:54.246Z" level=info msg="finished unary call with code OK" catfile.duration_ms=12 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=12 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3ZJ4K6H2D4S7DMCD4JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:24.232" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:54.233" grpc.time_ms=13.035 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 244.963148] gitaly[904]: time="2026-09-18T21:05:54.250Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:24.248" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:54.249" grpc.time_ms=0.636 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 244.995618] gitaly[904]: time="2026-09-18T21:05:54.282Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3ZJ4K6H2D4S7DMCD4JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:04.175" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:54.276" grpc.time_ms=6.06 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 245.019164] gitaly[904]: time="2026-09-18T21:05:54.306Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:24.304" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:54.305" grpc.time_ms=0.497 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 245.035477] gitaly[904]: time="2026-09-18T21:05:54.322Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:24.221" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:54.321" grpc.time_ms=0.512 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 245.040752] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.327Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ea2cb6e61f1ebcaf1abac5f9","created_at":"2026-09-18T21:05:54.325Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"9c87a6d7bdcbd19363e181ed","job_size_bytes":3,"pid":2512,"job_status":"deduplicated","message":"PipelineProcessWorker JID-ea2cb6e61f1ebcaf1abac5f9: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1935gitlab # [ 245.042309] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.329Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c87a6d7bdcbd19363e181ed","created_at":"2026-09-18T21:05:53.641Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f77cb9c486ac48c6","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.643Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2512,"job_status":"rescheduled","message":"PipelineProcessWorker JID-9c87a6d7bdcbd19363e181ed: rescheduled"}1936gitlab # [ 245.044789] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1691937gitlab # [ 245.046871] nixbot[2634]: {"ts": "2026-09-18T21:05:54.333Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/79f342e778e69e791392ca7ab634b2ccb8669e2c \"HTTP/1.1 201 Created\""}1938gitlab # [ 245.050673] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.337Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c87a6d7bdcbd19363e181ed","created_at":"2026-09-18T21:05:53.641Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f77cb9c486ac48c6","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.643Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c87a6d7bdcbd19363e181ed: done: 0.469435 sec","job_status":"done","queue_duration_s":0.224082,"scheduling_latency_s":0.224097,"gitaly_calls":3,"gitaly_duration_s":0.207889,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.021395,"redis_read_bytes":228,"redis_write_bytes":18461,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000458,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000691,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.005045,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12307,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.008263,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000313,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003623,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002544,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.133,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.121,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100333,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.434219713,"duration_s":0.469435,"completed_at":"2026-09-18T21:05:54.337Z","load_balancing_strategy":"primary","db_duration_s":0.134462,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1939gitlab # [ 245.087830] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.339Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bd3f3779fe77c7c58b3ccdfe"],"class":"WebHooks::LogExecutionWorker","jid":"f0199bc2278b256c2869bbaf","created_at":"2026-09-18T21:05:53.670Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-c0961931c53e412d","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7a8eea368fa61349df8eb4fd89767efc292ff3778a65e239ccbe4076fcf59654","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.673Z","job_size_bytes":2591,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f0199bc2278b256c2869bbaf: start","job_status":"start","queue_duration_s":0.666213,"scheduling_latency_s":0.66624}1940gitlab # [ 245.103690] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.362Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bd3f3779fe77c7c58b3ccdfe"],"class":"WebHooks::LogExecutionWorker","jid":"f0199bc2278b256c2869bbaf","created_at":"2026-09-18T21:05:53.670Z","trace_propagation_headers":{"sentry-trace":"2b19c3abd09e434c884d01f4ca306098-c0961931c53e412d","baggage":"sentry-trace_id=2b19c3abd09e434c884d01f4ca306098,sentry-release=Unknown"},"correlation_id":"01M2V5DYZR3CBQ6PK8KNKVEHTT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7a8eea368fa61349df8eb4fd89767efc292ff3778a65e239ccbe4076fcf59654","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.673Z","job_size_bytes":2591,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f0199bc2278b256c2869bbaf: done: 0.022996 sec","job_status":"done","queue_duration_s":0.666213,"scheduling_latency_s":0.66624,"redis_calls":7,"redis_duration_s":0.0046289999999999994,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022996,"completed_at":"2026-09-18T21:05:54.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1941gitlab # [ 245.152143] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.365Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9e07d0caef47abfb28593e0a","created_at":"2026-09-18T21:05:53.785Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-be8a08289e2e4993","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.794Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9e07d0caef47abfb28593e0a: start","job_status":"start","queue_duration_s":0.571187,"scheduling_latency_s":0.571203}1942gitlab # [ 245.194922] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.431Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9e07d0caef47abfb28593e0a","created_at":"2026-09-18T21:05:53.785Z","trace_propagation_headers":{"sentry-trace":"9b61f27aab264512aba66ffe47aa5b46-be8a08289e2e4993","baggage":"sentry-trace_id=9b61f27aab264512aba66ffe47aa5b46,sentry-release=Unknown"},"correlation_id":"01M2V5CK3593T4K2KA4TDPEKW9","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.794Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9e07d0caef47abfb28593e0a: done: 0.066549 sec","job_status":"done","queue_duration_s":0.571187,"scheduling_latency_s":0.571203,"redis_calls":11,"redis_duration_s":0.003026,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000667,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002013,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225727,"duration_s":0.066549,"completed_at":"2026-09-18T21:05:54.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1943gitlab # [ 245.200806] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.432Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c89b5590eea37375be3bc87a","created_at":"2026-09-18T21:05:53.971Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.975Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c89b5590eea37375be3bc87a: start","job_status":"start","queue_duration_s":0.457562,"scheduling_latency_s":0.457578}1944gitlab # [ 245.245393] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.461Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c89b5590eea37375be3bc87a","created_at":"2026-09-18T21:05:53.971Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:53.975Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c89b5590eea37375be3bc87a: done: 0.028948 sec","job_status":"done","queue_duration_s":0.457562,"scheduling_latency_s":0.457578,"redis_calls":7,"redis_duration_s":0.001026,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028948,"completed_at":"2026-09-18T21:05:54.461Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008123,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1945gitlab # [ 245.255827] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.462Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d99f92177b235b269b41519b","created_at":"2026-09-18T21:05:54.175Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.179Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d99f92177b235b269b41519b: start","job_status":"start","queue_duration_s":0.283532,"scheduling_latency_s":0.283548}1946gitlab # [ 245.294090] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.479Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"d99f92177b235b269b41519b","created_at":"2026-09-18T21:05:54.175Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.179Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-d99f92177b235b269b41519b: done: 0.016263 sec","job_status":"done","queue_duration_s":0.283532,"scheduling_latency_s":0.283548,"redis_calls":7,"redis_duration_s":0.000991,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016263,"completed_at":"2026-09-18T21:05:54.479Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1947gitlab # [ 245.308630] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.480Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5c9a77fb8cebdbc261469705","created_at":"2026-09-18T21:05:54.185Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.187Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5c9a77fb8cebdbc261469705: start","job_status":"start","queue_duration_s":0.29286,"scheduling_latency_s":0.292875}1948gitlab # [ 245.355222] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5c9a77fb8cebdbc261469705","created_at":"2026-09-18T21:05:54.185Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.187Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5c9a77fb8cebdbc261469705: done: 0.022999 sec","job_status":"done","queue_duration_s":0.29286,"scheduling_latency_s":0.292875,"redis_calls":7,"redis_duration_s":0.004541,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001962,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002579,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022999,"completed_at":"2026-09-18T21:05:54.503Z","load_balancing_strategy":"primary","db_duration_s":0.005333,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1949gitlab # [ 245.360171] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.504Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b28208c6ca9ed48942ceb94c","created_at":"2026-09-18T21:05:54.201Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.204Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b28208c6ca9ed48942ceb94c: start","job_status":"start","queue_duration_s":0.300246,"scheduling_latency_s":0.300262}1950gitlab # [ 245.408622] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b28208c6ca9ed48942ceb94c","created_at":"2026-09-18T21:05:54.201Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.204Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b28208c6ca9ed48942ceb94c: done: 0.018388 sec","job_status":"done","queue_duration_s":0.300246,"scheduling_latency_s":0.300262,"redis_calls":10,"redis_duration_s":0.0013340000000000001,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000374,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018388,"completed_at":"2026-09-18T21:05:54.522Z","load_balancing_strategy":"primary","db_duration_s":0.00271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 245.413402] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2b1bddbdc5ea8dbb6a442108","created_at":"2026-09-18T21:05:54.205Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.210Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2b1bddbdc5ea8dbb6a442108: start","job_status":"start","queue_duration_s":0.313016,"scheduling_latency_s":0.31303}1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821'1953gitlab # [ 245.428945] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2b1bddbdc5ea8dbb6a442108","created_at":"2026-09-18T21:05:54.205Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.210Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2b1bddbdc5ea8dbb6a442108: done: 0.022159 sec","job_status":"done","queue_duration_s":0.313016,"scheduling_latency_s":0.31303,"redis_calls":7,"redis_duration_s":0.001155,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022159,"completed_at":"2026-09-18T21:05:54.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821', in 0.05 seconds)1955(finished: subtest: push delivers the webhook, in 47.29 seconds)1956gitlab # [ 245.476872] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"81d8692515620fd85203126e","created_at":"2026-09-18T21:05:54.212Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.215Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-81d8692515620fd85203126e: start","job_status":"start","queue_duration_s":0.332103,"scheduling_latency_s":0.332128}1957subtest: eval and build post commit statuses1958gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses1959gitlab # [ 245.481893] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.564Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"81d8692515620fd85203126e","created_at":"2026-09-18T21:05:54.212Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.215Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-81d8692515620fd85203126e: done: 0.017326 sec","job_status":"done","queue_duration_s":0.332103,"scheduling_latency_s":0.332128,"redis_calls":8,"redis_duration_s":0.001213,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017326,"completed_at":"2026-09-18T21:05:54.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1960gitlab # [ 245.545641] gitaly[904]: time="2026-09-18T21:05:54.765Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:54.764" grpc.time_ms=0.383 pid=904 span.kind=server system=grpc1961gitlab # [ 245.546278] gitaly[904]: time="2026-09-18T21:05:54.785Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:54.784" grpc.time_ms=0.426 pid=904 span.kind=server system=grpc1962gitlab # [ 245.546979] nixbot[2634]: INFO: ::ffff:127.0.0.1:50896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 200 OK1963gitlab # [ 245.547628] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.565Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f037e1fea180f2e41574b927","created_at":"2026-09-18T21:05:54.215Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.217Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f037e1fea180f2e41574b927: start","job_status":"start","queue_duration_s":0.348361,"scheduling_latency_s":0.348377}1964gitlab # [ 245.589289] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.579Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f037e1fea180f2e41574b927","created_at":"2026-09-18T21:05:54.215Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.217Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f037e1fea180f2e41574b927: done: 0.014539 sec","job_status":"done","queue_duration_s":0.348361,"scheduling_latency_s":0.348377,"redis_calls":7,"redis_duration_s":0.00103,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014539,"completed_at":"2026-09-18T21:05:54.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1965gitlab # [ 245.630585] gitaly[904]: time="2026-09-18T21:05:54.806Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:54.805" grpc.time_ms=0.665 pid=904 span.kind=server system=grpc1966gitlab # [ 245.631446] gitaly[904]: time="2026-09-18T21:05:54.817Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB diskcache=37524e3f-9ccd-4748-b0d2-b5df7651c499 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:24.744" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:54.744" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 245.632702] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.580Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1ace83c201c3504ef298d0a4","created_at":"2026-09-18T21:05:54.217Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.218Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1ace83c201c3504ef298d0a4: start","job_status":"start","queue_duration_s":0.362144,"scheduling_latency_s":0.36216}1968gitlab # [ 245.633677] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.669Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1ace83c201c3504ef298d0a4","created_at":"2026-09-18T21:05:54.217Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.218Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1ace83c201c3504ef298d0a4: done: 0.088372 sec","job_status":"done","queue_duration_s":0.362144,"scheduling_latency_s":0.36216,"redis_calls":7,"redis_duration_s":0.001237,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.088372,"completed_at":"2026-09-18T21:05:54.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.071136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1969gitlab # [ 245.682172] gitaly[904]: time="2026-09-18T21:05:54.818Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=67 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7016 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:24.744" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:54.744" grpc.time_ms=73.218 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 245.682789] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.670Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2c80a4b7c564439a91ed1a03","created_at":"2026-09-18T21:05:54.219Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.220Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2c80a4b7c564439a91ed1a03: start","job_status":"start","queue_duration_s":0.450493,"scheduling_latency_s":0.450514}1971gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.22 seconds)1972gitlab # [ 245.688906] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2c80a4b7c564439a91ed1a03","created_at":"2026-09-18T21:05:54.219Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.220Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2c80a4b7c564439a91ed1a03: done: 0.010706 sec","job_status":"done","queue_duration_s":0.450493,"scheduling_latency_s":0.450514,"redis_calls":7,"redis_duration_s":0.00101,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010706,"completed_at":"2026-09-18T21:05:54.681Z","load_balancing_strategy":"primary","db_duration_s":0.000326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973gitlab # [ 245.735171] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.682Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"32d42742b1f4cf25ea91444c","created_at":"2026-09-18T21:05:54.220Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.221Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-32d42742b1f4cf25ea91444c: start","job_status":"start","queue_duration_s":0.460952,"scheduling_latency_s":0.460967}1974gitlab # [ 245.740902] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.698Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"32d42742b1f4cf25ea91444c","created_at":"2026-09-18T21:05:54.220Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.221Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-32d42742b1f4cf25ea91444c: done: 0.015769 sec","job_status":"done","queue_duration_s":0.460952,"scheduling_latency_s":0.460967,"redis_calls":7,"redis_duration_s":0.001338,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015769,"completed_at":"2026-09-18T21:05:54.698Z","load_balancing_strategy":"primary","db_duration_s":0.002225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1975gitlab # [ 245.780751] gitaly[904]: time="2026-09-18T21:05:54.985Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=56 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=56 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:24.027" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:54.927" grpc.time_ms=57.14 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 245.786886] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 2001977gitlab # [ 245.788625] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:54.699Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"73496e1bac11238207aec478","created_at":"2026-09-18T21:05:54.329Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.330Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-73496e1bac11238207aec478: start","job_status":"start","queue_duration_s":0.368501,"scheduling_latency_s":0.368515}1978gitlab # [ 245.839515] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.024Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"73496e1bac11238207aec478","created_at":"2026-09-18T21:05:54.329Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-cbd4d734000f43d1","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.330Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-73496e1bac11238207aec478: done: 0.325934 sec","job_status":"done","queue_duration_s":0.368501,"scheduling_latency_s":0.368515,"gitaly_calls":3,"gitaly_duration_s":0.137235,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.072185,"redis_read_bytes":141,"redis_write_bytes":16719,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000368,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000736,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.002224,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11225,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.066399,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000191,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000397,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001502,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089266,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.303970476,"duration_s":0.325934,"completed_at":"2026-09-18T21:05:55.024Z","load_balancing_strategy":"primary","db_duration_s":0.034113,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1979gitlab # [ 245.847146] gitaly[904]: time="2026-09-18T21:05:54.996Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E4MCBR1PSBV87ZERDXJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:24.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:54.995" grpc.time_ms=0.632 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 245.893697] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.026Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5d19866cb4cc256349adb222","created_at":"2026-09-18T21:05:54.738Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.740Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5d19866cb4cc256349adb222: start","job_status":"start","queue_duration_s":0.285647,"scheduling_latency_s":0.285663}1981gitlab # [ 245.894459] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.059Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5d19866cb4cc256349adb222","created_at":"2026-09-18T21:05:54.738Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.740Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5d19866cb4cc256349adb222: done: 0.033561 sec","job_status":"done","queue_duration_s":0.285647,"scheduling_latency_s":0.285663,"redis_calls":7,"redis_duration_s":0.0021479999999999997,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033561,"completed_at":"2026-09-18T21:05:55.059Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004921,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1982gitlab # [ 245.910860] gitaly[904]: time="2026-09-18T21:05:55.015Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E3BVXX9897ZB89DBMFZB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:25.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:55.015" grpc.time_ms=0.543 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 245.953318] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.061Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"deff260327071a7c28b18e20","created_at":"2026-09-18T21:05:54.822Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.824Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-deff260327071a7c28b18e20: start","job_status":"start","queue_duration_s":0.236636,"scheduling_latency_s":0.236658}1984gitlab # [ 245.953908] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.079Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"deff260327071a7c28b18e20","created_at":"2026-09-18T21:05:54.822Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.824Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-deff260327071a7c28b18e20: done: 0.018179 sec","job_status":"done","queue_duration_s":0.236636,"scheduling_latency_s":0.236658,"redis_calls":7,"redis_duration_s":0.001167,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018179,"completed_at":"2026-09-18T21:05:55.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985gitlab # [ 245.973597] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.080Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4898c639521474f6caca9c21","created_at":"2026-09-18T21:05:54.829Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.831Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4898c639521474f6caca9c21: start","job_status":"start","queue_duration_s":0.249634,"scheduling_latency_s":0.249649}1986gitlab # [ 245.987610] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.098Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4898c639521474f6caca9c21","created_at":"2026-09-18T21:05:54.829Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.831Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4898c639521474f6caca9c21: done: 0.01768 sec","job_status":"done","queue_duration_s":0.249634,"scheduling_latency_s":0.249649,"redis_calls":7,"redis_duration_s":0.001055,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01768,"completed_at":"2026-09-18T21:05:55.098Z","load_balancing_strategy":"primary","db_duration_s":0.002866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 246.031398] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.099Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f3344c0086d620150b910cb1","created_at":"2026-09-18T21:05:54.839Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.904Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f3344c0086d620150b910cb1: start","job_status":"start","queue_duration_s":0.194689,"scheduling_latency_s":0.194704}1988gitlab # [ 246.036903] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.119Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f3344c0086d620150b910cb1","created_at":"2026-09-18T21:05:54.839Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.904Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f3344c0086d620150b910cb1: done: 0.019973 sec","job_status":"done","queue_duration_s":0.194689,"scheduling_latency_s":0.194704,"redis_calls":10,"redis_duration_s":0.0017,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000457,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019973,"completed_at":"2026-09-18T21:05:55.119Z","load_balancing_strategy":"primary","db_duration_s":0.00288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1989gitlab # [ 246.091568] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"731460df79c3e207aca7947d","created_at":"2026-09-18T21:05:54.905Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.906Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-731460df79c3e207aca7947d: start","job_status":"start","queue_duration_s":0.213437,"scheduling_latency_s":0.213452}1990gitlab # [ 246.092193] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"731460df79c3e207aca7947d","created_at":"2026-09-18T21:05:54.905Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.906Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-731460df79c3e207aca7947d: done: 0.016958 sec","job_status":"done","queue_duration_s":0.213437,"scheduling_latency_s":0.213452,"redis_calls":7,"redis_duration_s":0.001135,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016958,"completed_at":"2026-09-18T21:05:55.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 246.130724] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d86650e6dfa0c9fc5631caa","created_at":"2026-09-18T21:05:54.907Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.908Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d86650e6dfa0c9fc5631caa: start","job_status":"start","queue_duration_s":0.229569,"scheduling_latency_s":0.229584}1992gitlab # [ 246.139519] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d86650e6dfa0c9fc5631caa","created_at":"2026-09-18T21:05:54.907Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.908Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d86650e6dfa0c9fc5631caa: done: 0.015862 sec","job_status":"done","queue_duration_s":0.229569,"scheduling_latency_s":0.229584,"redis_calls":8,"redis_duration_s":0.001239,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015862,"completed_at":"2026-09-18T21:05:55.154Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 246.190781] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.155Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"afc3e9a26614728731791c53","created_at":"2026-09-18T21:05:54.909Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.910Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-afc3e9a26614728731791c53: start","job_status":"start","queue_duration_s":0.244675,"scheduling_latency_s":0.244689}1994gitlab # [ 246.191636] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.169Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"afc3e9a26614728731791c53","created_at":"2026-09-18T21:05:54.909Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.910Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-afc3e9a26614728731791c53: done: 0.014497 sec","job_status":"done","queue_duration_s":0.244675,"scheduling_latency_s":0.244689,"redis_calls":7,"redis_duration_s":0.001005,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014497,"completed_at":"2026-09-18T21:05:55.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 246.258298] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.170Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"63b34de1826f0751e9aee5e2","created_at":"2026-09-18T21:05:54.910Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.911Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-63b34de1826f0751e9aee5e2: start","job_status":"start","queue_duration_s":0.258811,"scheduling_latency_s":0.258826}1996gitlab # [ 246.258899] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.187Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"63b34de1826f0751e9aee5e2","created_at":"2026-09-18T21:05:54.910Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.911Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-63b34de1826f0751e9aee5e2: done: 0.017199 sec","job_status":"done","queue_duration_s":0.258811,"scheduling_latency_s":0.258826,"redis_calls":7,"redis_duration_s":0.001318,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017199,"completed_at":"2026-09-18T21:05:55.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 246.280334] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.188Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5c3ec5ec3d0d256badaff3fd","created_at":"2026-09-18T21:05:54.912Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.913Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5c3ec5ec3d0d256badaff3fd: start","job_status":"start","queue_duration_s":0.275475,"scheduling_latency_s":0.27549}1998gitlab # [ 246.294235] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5c3ec5ec3d0d256badaff3fd","created_at":"2026-09-18T21:05:54.912Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.913Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5c3ec5ec3d0d256badaff3fd: done: 0.009196 sec","job_status":"done","queue_duration_s":0.275475,"scheduling_latency_s":0.27549,"redis_calls":7,"redis_duration_s":0.001002,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009196,"completed_at":"2026-09-18T21:05:55.197Z","load_balancing_strategy":"primary","db_duration_s":0.000348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 246.349608] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.198Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"07751173f5d4fa6e5c9c2838","created_at":"2026-09-18T21:05:54.913Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.914Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-07751173f5d4fa6e5c9c2838: start","job_status":"start","queue_duration_s":0.284444,"scheduling_latency_s":0.284457}2000gitlab # [ 246.350450] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.214Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"07751173f5d4fa6e5c9c2838","created_at":"2026-09-18T21:05:54.913Z","trace_propagation_headers":{"sentry-trace":"fbb15bb9652440f7bf94e8729106723d-f529e46ae78844eb","baggage":"sentry-trace_id=fbb15bb9652440f7bf94e8729106723d,sentry-release=Unknown"},"correlation_id":"01M2V5E3BVXX9897ZB89DBMFZB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:54.914Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-07751173f5d4fa6e5c9c2838: done: 0.015626 sec","job_status":"done","queue_duration_s":0.284444,"scheduling_latency_s":0.284457,"redis_calls":7,"redis_duration_s":0.001036,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015626,"completed_at":"2026-09-18T21:05:55.214Z","load_balancing_strategy":"primary","db_duration_s":0.002629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 246.444548] gitaly[904]: time="2026-09-18T21:05:55.731Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-18T21:06:25.218" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:55.719" grpc.time_ms=12.032 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 246.461766] gitaly[904]: time="2026-09-18T21:05:55.748Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:05.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:55.738" grpc.time_ms=9.597 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003gitlab # [ 246.498455] gitaly[904]: time="2026-09-18T21:05:55.785Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-18T21:06:05.054" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.785" grpc.time_ms=0.234 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 246.513462] gitaly[904]: time="2026-09-18T21:05:55.800Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-18T21:06:05.060" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:05:55.790" grpc.time_ms=9.594 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 246.563653] gitaly[904]: time="2026-09-18T21:05:55.850Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:55.849" grpc.time_ms=0.342 pid=904 span.kind=server system=grpc2006gitlab # [ 246.600626] gitaly[904]: time="2026-09-18T21:05:55.887Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:05:55.887" grpc.time_ms=0.316 pid=904 span.kind=server system=grpc2007gitlab # [ 246.612036] gitaly[904]: time="2026-09-18T21:05:55.898Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:05.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.814" operations="[repack_refs]" pid=904 ref=refs/keep-around/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 remote_ip="2001:db8:1::1" revision=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 span.kind=server system=grpc username=root2008gitlab # [ 246.622974] gitaly[904]: time="2026-09-18T21:05:55.901Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:05.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.814" pid=904 ref=refs/keep-around/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-18 21:04:57.54028387 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 span.kind=server system=grpc username=root2009gitlab # [ 246.639297] gitaly[904]: time="2026-09-18T21:05:55.905Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW diskcache=e7ceb39c-e2fc-4077-89aa-e948013a669e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:05.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.814" pid=904 ref=refs/keep-around/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 remote_ip="2001:db8:1::1" revision=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 span.kind=server system=grpc username=root2010gitlab # [ 246.651688] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.920Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"0516c021c02afe736a06f55c","created_at":"2026-09-18T21:05:55.915Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-97cd752d73cc462b","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:55.919Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-0516c021c02afe736a06f55c: start","job_status":"start","queue_duration_s":0.001602,"scheduling_latency_s":0.001636}2011gitlab # [ 246.651888] gitaly[904]: time="2026-09-18T21:05:55.905Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5517 command.oublock=8 command.real_time_ms=82 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:05.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.814" grpc.time_ms=90.797 pid=904 ref=refs/keep-around/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 remote_ip="2001:db8:1::1" revision=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 span.kind=server system=grpc username=root2012gitlab # [ 246.652626] gitaly[904]: time="2026-09-18T21:05:55.911Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:25.409" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:55.910" grpc.time_ms=0.427 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 246.653529] gitaly[904]: time="2026-09-18T21:05:55.919Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:05.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.814" pid=904 ref=refs/keep-around/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 remote_ip="2001:db8:1::1" revision=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2014gitlab # [ 246.702359] gitaly[904]: time="2026-09-18T21:05:55.920Z" level=info msg="optimized repository" clean_stale_data_time=17.355279ms clean_work_trees_time="173.486µs" commit_graph_time="8.381µs" correlation_id=01M2V5E42ZX1R1C0B5E519A7PW gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="9.219µs" pid=904 prune_time="8.381µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="8.661µs" storage_name=default system=housekeeping total_time=17.835227ms2015gitlab # [ 246.703080] gitaly[904]: time="2026-09-18T21:05:55.920Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-18T21:06:05.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-18T21:05:55.814" pid=904 ref=refs/keep-around/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 remote_ip="2001:db8:1::1" revision=82a45f0a3c3fbe4f40a60e728b189fd0358ec821 span.kind=server system=grpc username=root2016gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses2017gitlab # [ 246.703515] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.953Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"0516c021c02afe736a06f55c","created_at":"2026-09-18T21:05:55.915Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-97cd752d73cc462b","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:55.919Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-0516c021c02afe736a06f55c: done: 0.033253 sec","job_status":"done","queue_duration_s":0.001602,"scheduling_latency_s":0.001636,"redis_calls":7,"redis_duration_s":0.001501,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033253,"completed_at":"2026-09-18T21:05:55.953Z","load_balancing_strategy":"primary","db_duration_s":0.004458,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2018gitlab # [ 246.743116] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.955Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ea5572d524eeee44ffbfc353","created_at":"2026-09-18T21:05:55.919Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-97cd752d73cc462b","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:55.922Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ea5572d524eeee44ffbfc353: start","job_status":"start","queue_duration_s":0.033653,"scheduling_latency_s":0.033682}2019gitlab # [ 246.743839] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:55.989Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ea5572d524eeee44ffbfc353","created_at":"2026-09-18T21:05:55.919Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-97cd752d73cc462b","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:55.922Z","job_size_bytes":65,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ea5572d524eeee44ffbfc353: done: 0.033699 sec","job_status":"done","queue_duration_s":0.033653,"scheduling_latency_s":0.033682,"redis_calls":10,"redis_duration_s":0.001281,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033699,"completed_at":"2026-09-18T21:05:55.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 246.812707] gitaly[904]: time="2026-09-18T21:05:56.099Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E5V60HQDJ88E5QMA1RNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:26.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:56.098" grpc.time_ms=0.522 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.08 seconds)2022gitlab # [ 246.823232] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 382023gitlab # [ 246.851641] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:56.138Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a5bb7903ebb5cf53b28f5596","created_at":"2026-09-18T21:05:56.134Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-97cd752d73cc462b","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:56.137Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a5bb7903ebb5cf53b28f5596: start","job_status":"start","queue_duration_s":0.001154,"scheduling_latency_s":0.001184}2024gitlab # [ 246.859586] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 18742025gitlab # [ 246.861093] nixbot[2634]: {"ts": "2026-09-18T21:05:56.147Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 \"HTTP/1.1 201 Created\""}2026gitlab # [ 246.867519] nixbot[2634]: {"ts": "2026-09-18T21:05:56.154Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-82a45f0a3c3f-5"}2027gitlab # [ 246.913870] gitaly[904]: time="2026-09-18T21:05:56.200Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:26.199" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:56.199" grpc.time_ms=1.002 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 246.937254] gitaly[904]: time="2026-09-18T21:05:56.224Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E42ZX1R1C0B5E519A7PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:26.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:56.223" grpc.time_ms=0.982 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 246.959077] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:56.245Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a5bb7903ebb5cf53b28f5596","created_at":"2026-09-18T21:05:56.134Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-97cd752d73cc462b","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:56.137Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a5bb7903ebb5cf53b28f5596: done: 0.107392 sec","job_status":"done","queue_duration_s":0.001154,"scheduling_latency_s":0.001184,"gitaly_calls":2,"gitaly_duration_s":0.016457,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005139,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000604,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000712,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000224,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001805,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000176,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000319,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068332,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.074750003,"duration_s":0.107392,"completed_at":"2026-09-18T21:05:56.245Z","load_balancing_strategy":"primary","db_duration_s":0.018288,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2030gitlab # [ 246.965285] nixbot[2634]: {"ts": "2026-09-18T21:05:56.246Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-82a45f0a3c3f-5", "argv0": "bwrap"}2031gitlab # [ 247.007512] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:56.294Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d3ee8cefa8fa405213342d42","created_at":"2026-09-18T21:05:56.187Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-fbdfc1f84bbf4743","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:56.188Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d3ee8cefa8fa405213342d42: start","job_status":"start","queue_duration_s":0.105425,"scheduling_latency_s":0.105456}2032gitlab # [ 247.030768] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:05:56.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d3ee8cefa8fa405213342d42","created_at":"2026-09-18T21:05:56.187Z","trace_propagation_headers":{"sentry-trace":"c69230688ce44f20871159cdd47c1364-fbdfc1f84bbf4743","baggage":"sentry-trace_id=c69230688ce44f20871159cdd47c1364,sentry-release=Unknown"},"correlation_id":"01M2V5E42ZX1R1C0B5E519A7PW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T21:05:56.188Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d3ee8cefa8fa405213342d42: done: 0.023468 sec","job_status":"done","queue_duration_s":0.105425,"scheduling_latency_s":0.105456,"redis_calls":7,"redis_duration_s":0.000935,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023468,"completed_at":"2026-09-18T21:05:56.317Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 247.117638] nix-daemon[2793]: accepted connection from pid 3660, user nixbot2034gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses2035gitlab # [ 247.920057] gitaly[904]: time="2026-09-18T21:05:57.206Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E6WF88W8RBCC47HN4S53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:27.105" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:57.205" grpc.time_ms=0.809 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab # [ 247.956931] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1072037gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.13 seconds)2038gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses2039gitlab # [ 249.014786] gitaly[904]: time="2026-09-18T21:05:58.300Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E7ZYBHV5SJSDBJA96JFR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:28.299" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:58.300" grpc.time_ms=0.628 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 249.043442] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 482041gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.09 seconds)2042gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses2043gitlab # [ 250.115717] gitaly[904]: time="2026-09-18T21:05:59.402Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5E91Y0DESXXW89P5F009R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:29.301" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:05:59.401" grpc.time_ms=0.552 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 250.136676] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:05:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 642045gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.09 seconds)2046gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses2047gitlab # [ 251.232248] gitaly[904]: time="2026-09-18T21:06:00.518Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EA4DQ207C639EF3D0Y85 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:30.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:00.517" grpc.time_ms=1.12 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 251.281216] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1052049gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.15 seconds)2050gitlab # [ 251.360607] nix-daemon[2793]: accepted connection from pid 3695, user nixbot2051gitlab # [ 251.371996] nix-daemon[2793]: accepted connection from pid 3660, user nixbot2052gitlab # [ 251.450888] gitaly[904]: time="2026-09-18T21:06:00.737Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:30.235" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:00.736" grpc.time_ms=0.878 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 251.487157] gitaly[904]: time="2026-09-18T21:06:00.773Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:10.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:00.762" grpc.time_ms=11.533 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 251.566538] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:00.852Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c1654ccf16f74615ccba06cd","created_at":"2026-09-18T21:06:00.844Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-285ec21af1744395","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:00.849Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c1654ccf16f74615ccba06cd: start","job_status":"start","queue_duration_s":0.002322,"scheduling_latency_s":0.00238}2055gitlab # [ 251.601717] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1722056gitlab # [ 251.603071] nixbot[2634]: {"ts": "2026-09-18T21:06:00.872Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 \"HTTP/1.1 201 Created\""}2057gitlab # [ 251.663844] gitaly[904]: time="2026-09-18T21:06:00.950Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EAHDEQ3XFPSJHEX8M6AG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:30.048" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:00.949" grpc.time_ms=1.104 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 251.708144] gitaly[904]: time="2026-09-18T21:06:00.995Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5EAHDEQ3XFPSJHEX8M6AG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:10.216" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:00.986" grpc.time_ms=8.445 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 251.709355] gitaly[904]: time="2026-09-18T21:06:00.996Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:06:00.994" grpc.time_ms=1.311 pid=904 span.kind=server system=grpc2060gitlab # [ 251.746914] nixbot[2634]: {"ts": "2026-09-18T21:06:01.032Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 \"HTTP/1.1 201 Created\""}2061gitlab # [ 251.747336] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1532062gitlab # [ 251.753595] gitaly[904]: time="2026-09-18T21:06:01.040Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:06:01.039" grpc.time_ms=0.461 pid=904 span.kind=server system=grpc2063gitlab # [ 251.783389] gitaly[904]: time="2026-09-18T21:06:01.070Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:06:01.069" grpc.time_ms=0.501 pid=904 span.kind=server system=grpc2064gitlab # [ 251.792360] gitaly[904]: time="2026-09-18T21:06:01.079Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EAPKXD116TE8DARNTBZF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:31.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:01.078" grpc.time_ms=0.482 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 251.811745] gitaly[904]: time="2026-09-18T21:06:01.098Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 diskcache=0d7f45b5-88e4-4259-854a-621c100d9a9a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:30.058" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:00.958" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 251.811979] gitaly[904]: time="2026-09-18T21:06:01.098Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7755 command.oublock=0 command.real_time_ms=133 command.spawn_token_fork_ms=1 command.system_time_ms=51 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:30.058" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:00.958" grpc.time_ms=140.016 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 251.821986] gitaly[904]: time="2026-09-18T21:06:01.108Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5EAPKXD116TE8DARNTBZF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-18T21:06:11.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:01.102" grpc.time_ms=5.999 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 251.853758] gitaly[904]: time="2026-09-18T21:06:01.140Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-18T21:06:31.139" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:01.139" grpc.time_ms=0.69 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 251.856554] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1002070gitlab # [ 251.858800] nixbot[2634]: {"ts": "2026-09-18T21:06:01.145Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82a45f0a3c3fbe4f40a60e728b189fd0358ec821 \"HTTP/1.1 201 Created\""}2071gitlab # [ 251.881860] gitaly[904]: time="2026-09-18T21:06:01.168Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:31.167" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:01.168" grpc.time_ms=0.574 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 251.890850] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.177Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9f77729610ffbc9850e5968d","created_at":"2026-09-18T21:06:01.175Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"c1654ccf16f74615ccba06cd","job_size_bytes":3,"pid":2512,"job_status":"deduplicated","message":"PipelineProcessWorker JID-9f77729610ffbc9850e5968d: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2073gitlab # [ 251.892751] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.179Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c1654ccf16f74615ccba06cd","created_at":"2026-09-18T21:06:00.844Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-285ec21af1744395","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:00.849Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2512,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c1654ccf16f74615ccba06cd: rescheduled"}2074gitlab # [ 251.898545] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.185Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c1654ccf16f74615ccba06cd","created_at":"2026-09-18T21:06:00.844Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-285ec21af1744395","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:00.849Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c1654ccf16f74615ccba06cd: done: 0.33327 sec","job_status":"done","queue_duration_s":0.002322,"scheduling_latency_s":0.00238,"gitaly_calls":3,"gitaly_duration_s":0.149134,"redis_calls":80,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016377,"redis_read_bytes":240,"redis_write_bytes":21865,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001299,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001424,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003103,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005652,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000938,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00038,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002282,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.13279,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.277484708,"duration_s":0.33327,"completed_at":"2026-09-18T21:06:01.185Z","load_balancing_strategy":"primary","db_duration_s":0.037038,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2075gitlab # [ 251.957184] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"444832285b7693b32f909f15","created_at":"2026-09-18T21:06:00.948Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:00.951Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-444832285b7693b32f909f15: start","job_status":"start","queue_duration_s":0.237624,"scheduling_latency_s":0.237659}2076gitlab # [ 251.957914] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.222Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"444832285b7693b32f909f15","created_at":"2026-09-18T21:06:00.948Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:00.951Z","job_size_bytes":23,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-444832285b7693b32f909f15: done: 0.032801 sec","job_status":"done","queue_duration_s":0.237624,"scheduling_latency_s":0.237659,"redis_calls":7,"redis_duration_s":0.002763,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032801,"completed_at":"2026-09-18T21:06:01.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005275,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2077gitlab # [ 252.007326] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.223Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"241f93182562a5df78dcf865","created_at":"2026-09-18T21:06:01.104Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.106Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-241f93182562a5df78dcf865: start","job_status":"start","queue_duration_s":0.117418,"scheduling_latency_s":0.11745}2078gitlab # [ 252.007969] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.244Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"241f93182562a5df78dcf865","created_at":"2026-09-18T21:06:01.104Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.106Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-241f93182562a5df78dcf865: done: 0.020942 sec","job_status":"done","queue_duration_s":0.117418,"scheduling_latency_s":0.11745,"redis_calls":7,"redis_duration_s":0.001056,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020942,"completed_at":"2026-09-18T21:06:01.244Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 252.063844] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f512ed512f8cb440b0d77b71","created_at":"2026-09-18T21:06:01.112Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.113Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f512ed512f8cb440b0d77b71: start","job_status":"start","queue_duration_s":0.134481,"scheduling_latency_s":0.134498}2080gitlab # [ 252.064630] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.273Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f512ed512f8cb440b0d77b71","created_at":"2026-09-18T21:06:01.112Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.113Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f512ed512f8cb440b0d77b71: done: 0.025225 sec","job_status":"done","queue_duration_s":0.134481,"scheduling_latency_s":0.134498,"redis_calls":7,"redis_duration_s":0.003066,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025225,"completed_at":"2026-09-18T21:06:01.273Z","load_balancing_strategy":"primary","db_duration_s":0.003989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 252.080131] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.274Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"55fcaa0a39653b896f8eb993","created_at":"2026-09-18T21:06:01.119Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.120Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-55fcaa0a39653b896f8eb993: start","job_status":"start","queue_duration_s":0.153971,"scheduling_latency_s":0.153992}2082gitlab # [ 252.092826] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.298Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"55fcaa0a39653b896f8eb993","created_at":"2026-09-18T21:06:01.119Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.120Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-55fcaa0a39653b896f8eb993: done: 0.023711 sec","job_status":"done","queue_duration_s":0.153971,"scheduling_latency_s":0.153992,"redis_calls":10,"redis_duration_s":0.0019100000000000002,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000382,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023711,"completed_at":"2026-09-18T21:06:01.298Z","load_balancing_strategy":"primary","db_duration_s":0.002693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2083gitlab # [ 252.131096] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d64cfe70d425aa2798ec96f4","created_at":"2026-09-18T21:06:01.121Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.122Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d64cfe70d425aa2798ec96f4: start","job_status":"start","queue_duration_s":0.177227,"scheduling_latency_s":0.177242}2084gitlab # [ 252.145461] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.323Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d64cfe70d425aa2798ec96f4","created_at":"2026-09-18T21:06:01.121Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.122Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d64cfe70d425aa2798ec96f4: done: 0.024394 sec","job_status":"done","queue_duration_s":0.177227,"scheduling_latency_s":0.177242,"redis_calls":7,"redis_duration_s":0.001161,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024394,"completed_at":"2026-09-18T21:06:01.323Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 252.196794] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 562086gitlab # [ 252.197551] gitaly[904]: time="2026-09-18T21:06:01.402Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5EB036KW4C3CVPGMVX0M9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.397" grpc.time_ms=5.664 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc2087gitlab # [ 252.198454] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.325Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e28a2d632484348e2dbd1da6","created_at":"2026-09-18T21:06:01.122Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.123Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e28a2d632484348e2dbd1da6: start","job_status":"start","queue_duration_s":0.201125,"scheduling_latency_s":0.201139}2088gitlab # [ 252.237718] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.344Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e28a2d632484348e2dbd1da6","created_at":"2026-09-18T21:06:01.122Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.123Z","job_size_bytes":19,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e28a2d632484348e2dbd1da6: done: 0.019063 sec","job_status":"done","queue_duration_s":0.201125,"scheduling_latency_s":0.201139,"redis_calls":8,"redis_duration_s":0.001791,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019063,"completed_at":"2026-09-18T21:06:01.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses2090gitlab # [ 252.251896] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.345Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a266385fed1068db531e3159","created_at":"2026-09-18T21:06:01.124Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.125Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a266385fed1068db531e3159: start","job_status":"start","queue_duration_s":0.219765,"scheduling_latency_s":0.21978}2091gitlab # [ 252.264490] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.370Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a266385fed1068db531e3159","created_at":"2026-09-18T21:06:01.124Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.125Z","job_size_bytes":66,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a266385fed1068db531e3159: done: 0.025337 sec","job_status":"done","queue_duration_s":0.219765,"scheduling_latency_s":0.21978,"redis_calls":7,"redis_duration_s":0.007855,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025337,"completed_at":"2026-09-18T21:06:01.370Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 252.312171] gitaly[904]: time="2026-09-18T21:06:01.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB1ZMV054CBHC2NPBSKG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.494" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2093gitlab # [ 252.313140] gitlab-workhorse[823]: time="2026-09-18T21:06:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672094gitlab # [ 252.313770] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 932095gitlab # [ 252.314235] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 492096gitlab # [ 252.314890] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7a21ce77baf3b2b3bdafc675","created_at":"2026-09-18T21:06:01.126Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.126Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7a21ce77baf3b2b3bdafc675: start","job_status":"start","queue_duration_s":0.248341,"scheduling_latency_s":0.248357}2097gitlab # [ 252.354346] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.415Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7a21ce77baf3b2b3bdafc675","created_at":"2026-09-18T21:06:01.126Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.126Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7a21ce77baf3b2b3bdafc675: done: 0.040255 sec","job_status":"done","queue_duration_s":0.248341,"scheduling_latency_s":0.248357,"redis_calls":7,"redis_duration_s":0.007605000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003974,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003631,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040255,"completed_at":"2026-09-18T21:06:01.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 252.364416] gitaly[904]: time="2026-09-18T21:06:01.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB1ZMV054CBHC2NPBSKG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.494" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc2099gitlab # [ 252.376763] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.425Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"715b3d939a37fdf1af691f79","created_at":"2026-09-18T21:06:01.129Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.130Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-715b3d939a37fdf1af691f79: start","job_status":"start","queue_duration_s":0.294815,"scheduling_latency_s":0.294833}2100gitlab # [ 252.429866] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.457Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"715b3d939a37fdf1af691f79","created_at":"2026-09-18T21:06:01.129Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.130Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-715b3d939a37fdf1af691f79: done: 0.031756 sec","job_status":"done","queue_duration_s":0.294815,"scheduling_latency_s":0.294833,"redis_calls":7,"redis_duration_s":0.00749,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031756,"completed_at":"2026-09-18T21:06:01.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2101gitlab # [ 252.431076] gitaly[904]: time="2026-09-18T21:06:01.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB1ZMV054CBHC2NPBSKG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.494" grpc.time_ms=6.94 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc2102gitlab # [ 252.443093] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.460Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7d267eab9a536e1683148f09","created_at":"2026-09-18T21:06:01.130Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.131Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7d267eab9a536e1683148f09: start","job_status":"start","queue_duration_s":0.328334,"scheduling_latency_s":0.328383}2103gitlab # [ 252.485178] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.473Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7d267eab9a536e1683148f09","created_at":"2026-09-18T21:06:01.130Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.131Z","job_size_bytes":6,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7d267eab9a536e1683148f09: done: 0.013885 sec","job_status":"done","queue_duration_s":0.328334,"scheduling_latency_s":0.328383,"redis_calls":7,"redis_duration_s":0.003279,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001366,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013885,"completed_at":"2026-09-18T21:06:01.473Z","load_balancing_strategy":"primary","db_duration_s":0.000284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2104gitlab # [ 252.534974] gitaly[904]: time="2026-09-18T21:06:01.576Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2V5EB5RT17SDTY81CKQWK0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.568" grpc.time_ms=8.25 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc2105gitlab # [ 252.535742] gitaly[904]: time="2026-09-18T21:06:01.635Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:06:01.635" grpc.time_ms=0.473 pid=904 span.kind=server system=grpc2106gitlab # [ 252.536481] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d6c8ed6206f50a2ae2ca189a","created_at":"2026-09-18T21:06:01.132Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.132Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d6c8ed6206f50a2ae2ca189a: start","job_status":"start","queue_duration_s":0.356279,"scheduling_latency_s":0.356296}2107gitlab # [ 252.537202] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.512Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d6c8ed6206f50a2ae2ca189a","created_at":"2026-09-18T21:06:01.132Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.132Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d6c8ed6206f50a2ae2ca189a: done: 0.023377 sec","job_status":"done","queue_duration_s":0.356279,"scheduling_latency_s":0.356296,"redis_calls":7,"redis_duration_s":0.003258,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023377,"completed_at":"2026-09-18T21:06:01.512Z","load_balancing_strategy":"primary","db_duration_s":0.008035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2108gitlab # [ 252.596751] sidekiq-cluster[2512]: {"severity":"INFO","time":"2026-09-18T21:06:01.513Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2e60029598cbc7af0c701255","created_at":"2026-09-18T21:06:01.179Z","trace_propagation_headers":{"sentry-trace":"7cea75bdf64346f4afd13771e857fba4-49bd09062b4442fa","baggage":"sentry-trace_id=7cea75bdf64346f4afd13771e857fba4,sentry-release=Unknown"},"correlation_id":"01M2V5EABSW4Q0SE93GAT4J243","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-18T21:06:01.181Z","job_size_bytes":3,"pid":2512,"sidekiq_tid":"m7wk","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2e60029598cbc7af0c701255: start","job_status":"start","queue_duration_s":0.33242,"scheduling_latency_s":0.332436}2109gitlab # [ 252.638459] gitaly[904]: time="2026-09-18T21:06:01.924Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB7BG0HNH1VB9AB03R92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.643" pid=904 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2110gitlab # [ 252.638888] gitaly[904]: time="2026-09-18T21:06:01.924Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=278 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB7BG0HNH1VB9AB03R92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.643" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc2111gitlab # [ 252.659953] gitaly[904]: time="2026-09-18T21:06:01.946Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=278 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB7BG0HNH1VB9AB03R92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-18T21:06:01.643" grpc.time_ms=282.129 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc2112gitlab # [ 252.674406] gitaly[904]: time="2026-09-18T21:06:01.947Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:06:01.946" grpc.time_ms=0.446 pid=904 span.kind=server system=grpc2113gitlab # [ 252.683458] gitaly[904]: time="2026-09-18T21:06:01.949Z" level=info msg="finished unary call with code OK" catfile.duration_ms=22 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=22 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EB8MC5Y57Y44C1MXPZWS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-18T21:06:31.924" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-18T21:06:01.924" grpc.time_ms=22.515 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 252.695250] gitlab-workhorse[823]: time="2026-09-18T21:06:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672115gitlab # [ 252.697151] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 3682116gitlab # [ 252.698986] gitaly[904]: time="2026-09-18T21:06:01.978Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-18T21:06:01.978" grpc.time_ms=0.285 pid=904 span.kind=server system=grpc2117gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses, in 0.43 seconds)2118gitlab # [ 252.708803] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/18:21:06:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82a45f0a3c3fbe4f40a60e728b189fd0358ec821/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 3702119(finished: subtest: eval and build post commit statuses, in 7.19 seconds)2120(finished: run the VM test script, in 300.83 seconds)2121gitlab # [ 252.711235] gitaly[904]: time="2026-09-18T21:06:01.996Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 diskcache=319b1519-658b-4e5e-9808-17a342215966 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:31.603" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:01.603" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 252.719904] gitaly[904]: time="2026-09-18T21:06:01.996Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=6873 command.oublock=0 command.real_time_ms=381 command.spawn_token_fork_ms=3 command.system_time_ms=44 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M2V5EABSW4Q0SE93GAT4J243 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-18T21:06:31.603" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-18T21:06:01.603" grpc.time_ms=392.679 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123test script finished in 300.85s2124cleanup2125kill QemuMachine (pid 46)2126gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2127(finished: cleanup, in 1.56 seconds)2128additionally exposed symbols:2129 gitlab,2130 vlan1,2131 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2132[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-18T21:05:07.222Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2133[]2134[]2135[]2136[]2137[]2138[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-18T21:05:54.263262Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2139[]2140[]2141[{'id': 5, 'sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T21:05:56.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2142[{'id': 5, 'sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T21:05:56.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2143[{'id': 5, 'sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T21:05:56.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2144[{'id': 5, 'sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-18T21:05:56.130Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2145[{'id': 5, 'sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-18T21:05:56.130Z', 'started_at': None, 'finished_at': '2026-09-18T21:06:00.832Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '82a45f0a3c3fbe4f40a60e728b189fd0358ec821', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-18T21:06:01.011Z', 'started_at': None, 'finished_at': '2026-09-18T21:06:01.124Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]