vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #413
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.NO8kOMZBKd', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 49.04 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab # Filesystem UUID: 7ac9f4a3-0035-4c57-b4e1-88202a0ef91217gitlab # Superblock backups stored on blocks:18gitlab # 32768, 98304, 163840, 22937619gitlab # 20gitlab # Allocating group tables: 0/8 done21gitlab # Writing inode tables: 0/8 done22gitlab # Creating journal (8192 blocks): done23gitlab # Writing superblocks and filesystem accounting information: 0/8 done24gitlab # 25gitlab # Virtualisation disk image created.26gitlab # Creating Nix store image...27gitlab # Created Nix store image.28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jxxzsmadgrvk1dkvyns9zvd3654cm21m-nixos-system-gitlab-test/init regInfo=/nix/store/bxq97jxl22p12zqzwla951v2g8bc27i5-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 492513179 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000803] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000871] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002725] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002735] Using GB pages for direct mapping73gitlab # [ 0.002844] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002852] ACPI: Early table checksum verification disabled75gitlab # [ 0.002854] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002858] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002862] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002869] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002871] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002873] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002874] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002876] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002877] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002878] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002879] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002879] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002880] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002880] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003120] No NUMA configuration found90gitlab # [ 0.003121] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003123] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005469] Zone ranges:93gitlab # [ 0.005469] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005471] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005472] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005473] Device empty97gitlab # [ 0.005474] Movable zone start for each node98gitlab # [ 0.005474] Early memory node ranges99gitlab # [ 0.005475] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005476] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005477] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005478] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005498] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005765] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115481] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.115921] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.115936] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.115970] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.115973] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.115975] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.115976] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.115977] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.115978] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.115980] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.115981] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.115986] TSC deadline timer available117gitlab # [ 0.115991] CPU topo: Max. logical packages: 1118gitlab # [ 0.115992] CPU topo: Max. logical dies: 1119gitlab # [ 0.115992] CPU topo: Max. dies per package: 1120gitlab # [ 0.115996] CPU topo: Max. threads per core: 1121gitlab # [ 0.115996] CPU topo: Num. cores per package: 4122gitlab # [ 0.115997] CPU topo: Num. threads per package: 4123gitlab # [ 0.115997] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116020] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116037] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116040] kvm-guest: setup PV sched yield127gitlab # [ 0.116056] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116057] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116058] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116060] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116062] Booting paravirtualized kernel on KVM132gitlab # [ 0.116065] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.120552] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.122772] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.122822] kvm-guest: PV spinlocks enabled136gitlab # [ 0.122823] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.122826] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jxxzsmadgrvk1dkvyns9zvd3654cm21m-nixos-system-gitlab-test/init regInfo=/nix/store/bxq97jxl22p12zqzwla951v2g8bc27i5-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.122921] Unknown kernel command line parameters "regInfo=/nix/store/bxq97jxl22p12zqzwla951v2g8bc27i5-closure-info/registration", will be passed to user space.139gitlab # [ 0.122934] random: crng init done140gitlab # [ 0.122935] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.131850] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.136162] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.136236] software IO TLB: area num 4.144gitlab # [ 0.211008] Fallback order for Node 0: 0145gitlab # [ 0.211015] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.211017] Policy zone: Normal147gitlab # [ 0.213506] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.223125] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.236603] allocated 12582912 bytes of page_ext150gitlab # [ 0.246926] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.246928] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.247812] Dynamic Preempt: lazy153gitlab # [ 0.248000] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.248001] rcu: RCU event tracing is enabled.155gitlab # [ 0.248001] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.248003] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.248004] Rude variant of Tasks RCU enabled.158gitlab # [ 0.248004] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.248005] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.248005] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.248031] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.248032] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.248034] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.252406] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.252730] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.252738] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.252850] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.256452] Console: colour VGA+ 80x25169gitlab # [ 0.256455] printk: legacy console [tty0] enabled170gitlab # [ 0.287369] printk: legacy console [ttyS0] enabled171gitlab # [ 0.395644] ACPI: Core revision 20250807172gitlab # [ 0.396619] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.398247] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.399273] x2apic enabled175gitlab # [ 0.400021] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.400995] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.402306] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.403829] kvm-guest: setup PV IPIs179gitlab # [ 0.405432] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.406500] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.408316] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.409402] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.410447] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.412313] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.413318] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.414314] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.415314] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.417111] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.418068] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.419122] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.420322] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.421314] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.422314] active return thunk: srso_alias_return_thunk194gitlab # [ 0.423334] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.424313] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.426313] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.427313] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.428314] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.429314] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.430313] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.431314] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.433118] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.434313] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.435312] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.436313] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.437313] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.467444] Freeing SMP alternatives memory: 44K208gitlab # [ 0.468274] pid_max: default: 32768 minimum: 301209gitlab # [ 0.469007] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.470351] landlock: Up and running.211gitlab # [ 0.471004] Yama: becoming mindful.212gitlab # [ 0.471523] LSM support for eBPF active213gitlab # [ 0.472551] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.474369] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.476933] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.477875] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.478319] ... version: 2218gitlab # [ 0.479093] ... bit width: 48219gitlab # [ 0.479316] ... generic counters: 6220gitlab # [ 0.480088] ... generic bitmap: 000000000000003f221gitlab # [ 0.480327] ... fixed-purpose counters: 0222gitlab # [ 0.481105] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.481316] ... value mask: 0000ffffffffffff224gitlab # [ 0.482272] ... max period: 00007fffffffffff225gitlab # [ 0.483045] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.483434] signal: max sigframe size: 3376227gitlab # [ 0.484250] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.484943] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.485513] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.490773] smp: Bringing up secondary CPUs ...231gitlab # [ 0.491733] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.492319] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.495427] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.497071] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.497801] Memory: 6011520K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.499317] devtmpfs: initialized237gitlab # [ 0.500411] x86/mm: Memory block size: 128MB238gitlab # [ 0.503496] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.505446] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.506403] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.507539] PM: RTC time: 11:32:38, date: 2026-10-04242gitlab # [ 0.511391] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.514027] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.514373] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.516422] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.517329] audit: initializing netlink subsys (disabled)247gitlab # [ 0.518341] audit: type=2000 audit(1791113557.914:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.518573] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.520316] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.521316] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.522315] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.523316] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.524332] cpuidle: using governor menu254gitlab # [ 0.526527] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.527591] PCI: Using configuration type 1 for base access256gitlab # [ 0.528317] PCI: Using configuration type 1 for extended access257gitlab # [ 0.529469] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.536009] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.538321] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.541330] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.543320] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.550804] ACPI: Added _OSI(Module Device)263gitlab # [ 0.552322] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.554325] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.562244] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.568522] ACPI: Interpreter enabled267gitlab # [ 0.570438] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.572325] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.574555] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.577324] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.579798] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.593905] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.596331] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.599283] acpiphp: Slot [3] registered275gitlab # [ 0.601363] acpiphp: Slot [4] registered276gitlab # [ 0.602376] acpiphp: Slot [5] registered277gitlab # [ 0.604372] acpiphp: Slot [6] registered278gitlab # [ 0.605370] acpiphp: Slot [7] registered279gitlab # [ 0.606395] acpiphp: Slot [8] registered280gitlab # [ 0.608373] acpiphp: Slot [9] registered281gitlab # [ 0.609393] acpiphp: Slot [10] registered282gitlab # [ 0.611375] acpiphp: Slot [11] registered283gitlab # [ 0.612397] acpiphp: Slot [12] registered284gitlab # [ 0.614371] acpiphp: Slot [13] registered285gitlab # [ 0.615360] acpiphp: Slot [14] registered286gitlab # [ 0.617358] acpiphp: Slot [15] registered287gitlab # [ 0.618189] acpiphp: Slot [16] registered288gitlab # [ 0.618865] acpiphp: Slot [17] registered289gitlab # [ 0.619335] acpiphp: Slot [18] registered290gitlab # [ 0.620084] acpiphp: Slot [19] registered291gitlab # [ 0.620340] acpiphp: Slot [20] registered292gitlab # [ 0.621069] acpiphp: Slot [21] registered293gitlab # [ 0.622336] acpiphp: Slot [22] registered294gitlab # [ 0.623106] acpiphp: Slot [23] registered295gitlab # [ 0.623337] acpiphp: Slot [24] registered296gitlab # [ 0.624063] acpiphp: Slot [25] registered297gitlab # [ 0.625339] acpiphp: Slot [26] registered298gitlab # [ 0.626102] acpiphp: Slot [27] registered299gitlab # [ 0.626337] acpiphp: Slot [28] registered300gitlab # [ 0.627060] acpiphp: Slot [29] registered301gitlab # [ 0.628338] acpiphp: Slot [30] registered302gitlab # [ 0.629097] acpiphp: Slot [31] registered303gitlab # [ 0.629334] PCI host bridge to bus 0000:00304gitlab # [ 0.630074] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.631317] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.632316] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.634317] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.635317] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.636317] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.637793] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.639820] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.641765] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.645367] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.646300] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.648213] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.649147] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.650214] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.651347] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.654365] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.656339] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.658610] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.659323] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.661550] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.683406] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.684331] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.685338] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.686509] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.689330] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.694345] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.695258] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.696117] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.709460] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.715740] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.727361] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.729338] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.732377] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.738464] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.750341] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.752338] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.755811] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.761473] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.769347] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.771333] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.773364] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.777335] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.785337] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.787333] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.790365] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.795020] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.802338] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.804334] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.805353] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.808581] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.812346] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.813261] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.814121] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.815302] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.817437] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.821349] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.822339] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.824553] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.828350] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.829275] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.830125] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.832951] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.836344] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.837263] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.838130] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.844168] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.845309] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.846261] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.847249] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.848203] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.851689] iommu: Default domain type: Translated375gitlab # [ 0.852956] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.854695] ACPI: bus type USB registered377gitlab # [ 0.855402] usbcore: registered new interface driver usbfs378gitlab # [ 0.856347] usbcore: registered new interface driver hub379gitlab # [ 0.857309] usbcore: registered new device driver usb380gitlab # [ 0.859502] NetLabel: Initializing381gitlab # [ 0.860166] NetLabel: domain hash size = 128382gitlab # [ 0.860888] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.862414] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.863327] PCI: Using ACPI for IRQ routing385gitlab # [ 0.864496] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.865312] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.865312] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.868320] vgaarb: loaded389gitlab # [ 0.869115] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.869977] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.873418] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.877151] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.877921] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.879535] pnp: PnP ACPI init395gitlab # [ 0.880782] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.889973] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.891665] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.892714] NET: Registered PF_INET protocol family399gitlab # [ 0.895032] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.914114] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.915713] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.917154] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.921060] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.922427] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.923655] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.925007] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.926485] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.927890] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.928915] NET: Registered PF_XDP protocol family410gitlab # [ 0.929816] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.930884] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.931943] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.933101] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.934265] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.935652] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.936668] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.939119] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.942382] PCI: CLS 0 bytes, default 64419gitlab # [ 0.943221] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.943788] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.944332] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.947131] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 0.968024] Initialise system trusted keyrings424gitlab # [ 0.969341] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.980812] Key type asymmetric registered426gitlab # [ 0.981536] Asymmetric key parser 'x509' registered427gitlab # [ 0.982443] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.984170] io scheduler mq-deadline registered429gitlab # [ 0.985026] io scheduler kyber registered430gitlab # [ 0.990699] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.994039] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.999935] Linux agpgart interface v0.103433gitlab # [ 1.001930] ACPI: bus type drm_connector registered434gitlab # [ 1.006988] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.009722] usbserial: USB Serial support registered for generic436gitlab # [ 1.012166] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.012166] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.017769] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.021400] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.024384] NET: Registered PF_INET6 protocol family441gitlab # [ 1.028440] Segment Routing with IPv6442gitlab # [ 1.030277] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.034284] IPI shorthand broadcast: enabled444gitlab # [ 1.045747] sched_clock: Marking stable (898036361, 147575112)->(1070244338, -24632865)445gitlab # [ 1.050129] registered taskstats version 1446gitlab # [ 1.052948] Loading compiled-in X.509 certificates447gitlab # [ 1.076216] Demotion targets for Node 0: null448gitlab # [ 1.078655] Key type .fscrypt registered449gitlab # [ 1.080045] Key type fscrypt-provisioning registered450gitlab # [ 1.082201] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.084082] ima: Allocated hash algorithm: sha1452gitlab # [ 1.085673] ima: No architecture policies found453gitlab # [ 1.087757] PM: Magic number: 14:966:528454gitlab # [ 1.090940] RAS: Correctable Errors collector initialized.455gitlab # [ 1.098614] clk: Disabling unused clocks456gitlab # [ 1.099330] PM: genpd: Disabling unused power domains457gitlab # [ 1.248884] Freeing initrd memory: 29392K458gitlab # [ 1.256197] Freeing unused decrypted memory: 2028K459gitlab # [ 1.262656] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.265356] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.270249] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.274187] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.342301] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.343535] Run /init as init process465gitlab # [ 1.356237] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.378283] fuse: init (API version 7.45)467gitlab # [ 1.387391] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.394931] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.398303] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.445757] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.782535] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.824500] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.826830] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.829061] systemd[1]: Running in initrd.475gitlab # [ 1.831714] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.834378] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.945127] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.991101] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.000388] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.001640] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.003129] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.004335] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.005480] systemd[1]: Reached target Path Units.484gitlab # [ 2.006400] systemd[1]: Reached target Slice Units.485gitlab # [ 2.007361] systemd[1]: Reached target Swaps.486gitlab # [ 2.008211] systemd[1]: Reached target Timer Units.487gitlab # [ 2.009270] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.010622] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.011817] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.012856] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.013944] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.014975] systemd[1]: Reached target Socket Units.493gitlab # [ 2.017095] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.019281] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.021518] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.030809] systemd[1]: Starting Journal Service...497gitlab # [ 2.035688] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.036806] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.050042] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.057673] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.059829] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.061427] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.066238] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.076762] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...505gitlab # [ 2.088756] systemd-journald[92]: Collecting audit messages is disabled.506gitlab # [ 2.091992] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.094490] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508gitlab # [ 2.096396] netfs: FS-Cache loaded509gitlab # [ 2.104313] 9pnet: Installing 9P2000 support510gitlab # [ 2.105717] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.109732] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.512gitlab # [ 2.111705] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.113442] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.115998] systemd[1]: Starting Apply Kernel Variables...515gitlab # [ 2.117846] systemd[1]: Starting Create Static Device Nodes in /dev...516gitlab # [ 2.130414] systemd[1]: Started Journal Service.517gitlab # [ 1.984109] systemd-modules-load[93]: Using 4 probe threads518gitlab # [ 1.986247] systemd-modules-load[93]: Inserted module 'virtio_balloon'519gitlab # [ 1.987514] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 1.988655] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 1.989684] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.990768] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.994326] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.995344] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.996183] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.997163] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.008397] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.020986] systemd-udevd[111]: Using default interface naming scheme 'v261'.529gitlab # [ 2.031892] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.058119] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.059423] systemd[1]: Reached target System Initialization.532gitlab # [ 2.060629] systemd[1]: Reached target Basic System.533gitlab # [ 2.289977] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12534gitlab # [ 2.292347] serio: i8042 KBD port at 0x60,0x64 irq 1535gitlab # [ 2.293185] serio: i8042 AUX port at 0x60,0x64 irq 12536gitlab # [ 2.301102] SCSI subsystem initialized537gitlab # [ 2.301985] uhci_hcd 0000:00:01.2: UHCI Host Controller538gitlab # [ 2.304145] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1539gitlab # [ 2.305542] uhci_hcd 0000:00:01.2: detected 2 ports540gitlab # [ 2.307831] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.312897] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.314232] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.317618] usb usb1: Product: UHCI Host Controller544gitlab # [ 2.318326] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd545gitlab # [ 2.319255] usb usb1: SerialNumber: 0000:00:01.2546gitlab # [ 2.325189] hub 1-0:1.0: USB hub found547gitlab # [ 2.326455] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.328354] virtio_blk virtio4: 4/0/0 default/read/poll queues549gitlab # [ 2.332930] scsi host0: ata_piix550gitlab # [ 2.334404] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)551gitlab # [ 2.335921] scsi host1: ata_piix552gitlab # [ 2.336544] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0553gitlab # [ 2.338475] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0554gitlab # [ 2.219279] systemd[1]: Starting Virtual Console Setup...555gitlab # [ 2.369024] virtio_blk virtio5: 4/0/0 default/read/poll queues556gitlab # [ 2.221906] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.557gitlab # [ 2.225274] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.558gitlab # [ 2.375546] virtio_blk virtio5: [vdb] 11952360 512-byte logical blocks (6.12 GB/5.70 GiB)559gitlab # [ 2.229367] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.248082] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 2.249749] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 2.497227] ata2: found unknown device (class 0)563gitlab # [ 2.500141] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100564gitlab # [ 2.504557] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5565gitlab # [ 2.539643] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0566gitlab # [ 2.545645] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.413244] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.566012] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray569gitlab # [ 2.419087] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.423268] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.425904] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.613268] cdrom: Uniform CD-ROM driver Revision: 3.20573gitlab # [ 2.471839] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks574gitlab # [ 2.476599] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.575gitlab # [ 2.716641] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.719694] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.722363] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.724052] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.725550] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.754998] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.767044] usbcore: registered new interface driver usbhid582gitlab # [ 2.768748] usbhid: USB HID core driver583gitlab # [ 2.776142] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.779750] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.907926] systemd[1]: Mounting /sysroot...586gitlab # [ 3.209076] EXT4-fs (vda): mounted filesystem 7ac9f4a3-0035-4c57-b4e1-88202a0ef912 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.069234] systemd[1]: Mounted /sysroot.588gitlab # [ 3.070585] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.073963] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.076146] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.078403] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.091540] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.096333] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.100252] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.103573] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.104887] systemd[1]: Mounted /sysroot/run.597gitlab # [ 3.107656] systemd[1]: Starting rw-sysroot-nix-store.service...598gitlab # [ 3.266278] 9p: Installing v9fs 9p2000 file system support599gitlab # [ 3.121707] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.600gitlab # [ 3.271837] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.126473] systemd[1]: Mounted /sysroot/tmp/xchg.602gitlab # [ 3.127610] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.128450] systemd[1]: Mounted /sysroot/tmp/shared.604gitlab # [ 3.129286] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.605gitlab # [ 3.130418] systemd[1]: Finished rw-sysroot-nix-store.service.606gitlab # [ 3.131299] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...607gitlab # [ 3.132922] systemd[1]: Reloading...608gitlab # [ 3.190252] systemd[1]: Reloading finished in 58 ms.609gitlab # [ 3.213667] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...610gitlab # [ 3.216754] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...611gitlab # [ 3.219647] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.221810] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.224334] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.226612] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.242500] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.245117] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.908823] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.960459] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.962365] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.964463] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.966669] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.992656] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.995733] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.010384] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.012324] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.014323] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.045271] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.047502] systemd[1]: Stopped target Basic System.629gitlab # [ 4.049326] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.051267] systemd[1]: Stopped target Path Units.631gitlab # [ 4.052956] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.055518] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.058243] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.060164] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.061906] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.063885] systemd[1]: Stopped target Swaps.637gitlab # [ 4.065532] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.067293] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.069791] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.073368] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.076172] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.079306] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.082825] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.084789] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.086598] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.087988] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.090080] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.091509] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.093603] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.095655] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.097515] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.098935] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.100183] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.101705] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.103394] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.104233] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.105382] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.106539] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.107354] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.108456] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.109407] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.110425] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.111281] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.112245] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.113339] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.114411] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.115221] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.116062] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.117233] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.118173] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.119414] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.120457] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.121473] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.154336] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.155624] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.157555] systemd[1]: Reached target Switch Root.677gitlab # [ 4.159845] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.292972] initrd-nixos-activation-start[227]: booting system configuration /nix/store/jxxzsmadgrvk1dkvyns9zvd3654cm21m-nixos-system-gitlab-test679gitlab # [ 4.339844] initrd-nixos-activation-start[227]: running activation script...680gitlab # [ 4.561289] initrd-nixos-activation-start[250]: setting up /etc...681gitlab # [ 4.684404] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.687135] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.689399] systemd[1]: Starting Switch Root...684gitlab # [ 4.726092] systemd[1]: Switching root.685gitlab # [ 4.931922] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.091758] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.469380] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.479544] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.481450] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.483477] systemd[1]: Detected first boot.691gitlab # [ 5.486179] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.638321] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.739826] systemd[1]: Applying preset policy.694gitlab # [ 5.914169] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 6.040017] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 6.041424] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 6.043943] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 6.046072] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 6.047507] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 6.049065] systemd[1]: Created slice User and Session Slice.701gitlab # [ 6.050196] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 6.051486] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 6.052622] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 6.053392] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 6.054220] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 6.055137] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 6.055959] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 6.056828] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 6.057812] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 6.058816] systemd[1]: Reached target Path Units.711gitlab # [ 6.059558] systemd[1]: Reached target Remote File Systems.712gitlab # [ 6.060364] systemd[1]: Reached target Slice Units.713gitlab # [ 6.061118] systemd[1]: Reached target Swaps.714gitlab # [ 6.062768] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 6.064948] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 6.066355] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 6.068061] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 6.069045] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 6.071625] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 6.073056] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 6.075478] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 6.076717] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 6.077919] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 6.079343] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 6.082269] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 6.083367] systemd[1]: Listening on udev Control Socket.727gitlab # [ 6.084317] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 6.087918] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.090239] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.092322] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.096663] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.100858] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.101917] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.106674] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.108404] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.110073] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.111806] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.127902] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.128907] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.135661] systemd[1]: Starting Journal Service...741gitlab # [ 6.138674] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.142821] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.152735] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.154903] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.161040] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.162783] systemd-journald[321]: Collecting audit messages is enabled.747gitlab # [ 6.168109] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.169928] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.171100] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.173564] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.175026] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 6.176424] loop: module loaded753gitlab # [ 6.177799] systemd[1]: Finished Create List of Static Device Nodes.754gitlab # [ 6.179232] systemd[1]: modprobe@configfs.service: Deactivated successfully.755gitlab # [ 6.180780] systemd[1]: Finished Load Kernel Module configfs.756gitlab # [ 6.034345] systemd[1]: Queued start job for default target Multi-User System.757gitlab # [ 6.181985] systemd[1]: Started Journal Service.758gitlab # [ 6.035980] systemd[1]: Unnecessary job was removed for /dev/vdb.759gitlab # [ 6.183648] EXT4-fs (vda): re-mounted 7ac9f4a3-0035-4c57-b4e1-88202a0ef912.760gitlab # [ 6.037483] systemd[1]: systemd-journald.service: Deactivated successfully.761gitlab # [ 6.039206] systemd-modules-load[322]: Using 3 probe threads762gitlab # [ 6.041958] systemd-modules-load[322]: Inserted module 'tls'763gitlab # [ 6.043264] systemd-modules-load[322]: Inserted module 'loop'764gitlab # [ 6.044347] systemd[1]: Mounted FUSE Control File System.765gitlab # [ 6.045360] systemd[1]: Finished Load Kernel Modules.766gitlab # [ 6.046310] systemd[1]: Mounting Kernel Configuration File System...767gitlab # [ 6.047478] systemd[1]: Starting Firewall...768gitlab # [ 6.054066] systemd[1]: Starting Apply Kernel Variables...769gitlab # [ 6.058234] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...770gitlab # [ 6.059515] systemd[1]: Finished Remount Root and Kernel File Systems.771gitlab # [ 6.060668] systemd[1]: Mounted Kernel Configuration File System.772gitlab # [ 6.062748] systemd-oomd[323]: No swap; memory pressure usage will be degraded773gitlab # [ 6.064156] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.774gitlab # [ 6.066902] systemd[1]: Listening on Disk Image Download Service Socket.775gitlab # [ 6.069442] systemd[1]: Starting Flush Journal to Persistent Storage...776gitlab # [ 6.071185] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore777gitlab # [ 6.075166] systemd[1]: Starting Load/Save OS Random Seed...778gitlab # [ 6.076279] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os779gitlab # [ 6.087851] systemd[1]: Finished Apply Kernel Variables.780gitlab # [ 6.089722] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 6.241693] systemd-journald[321]: Received client request to flush runtime journal.782gitlab # [ 6.130236] systemd[1]: Starting Create Static Device Nodes in /dev...783gitlab # [ 6.131488] systemd[1]: Finished Load/Save OS Random Seed.784gitlab # [ 6.132621] systemd[1]: Reached target First Boot Complete.785gitlab # [ 6.133643] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 6.134589] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 6.136769] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 6.137880] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 6.154916] systemd-udevd[361]: Using default interface naming scheme 'v261'.790gitlab # [ 6.175621] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.192947] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.270733] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.303573] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.308590] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.795gitlab # [ 6.312066] (udev-worker)[442]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.319917] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.322154] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.326850] systemd[1]: Finished Firewall.799gitlab # [ 6.337257] systemd[1]: Condition check resulted in Virtio network device being skipped.800gitlab # [ 6.338442] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore801gitlab # [ 6.340038] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67802gitlab # [ 6.342372] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore803gitlab # [ 6.344129] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.345600] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os805gitlab # [ 6.524215] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3806gitlab # [ 6.530118] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console807gitlab # [ 6.542335] Console: switching to colour dummy device 80x25808gitlab # [ 6.543454] [drm] Found bochs VGA, ID 0xb0c5.809gitlab # [ 6.543456] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.810gitlab # [ 6.548141] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic811gitlab # [ 6.548285] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0812gitlab # [ 6.548999] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0813gitlab # [ 6.554205] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5814gitlab # [ 6.556355] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4815gitlab # [ 6.558628] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD816gitlab # [ 6.559013] ACPI: button: Power Button [PWRF]817gitlab # [ 6.566130] Console: switching to colour frame buffer device 160x50818gitlab # [ 6.569220] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device819gitlab # [ 6.587025] mousedev: PS/2 mouse device common for all mice820gitlab # [ 6.591387] Floppy drive(s): fd0 is 2.88M AMI BIOS821gitlab # [ 6.591622] parport_pc 00:03: reported by Plug and Play ACPI822gitlab # [ 6.593664] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]823gitlab # [ 6.595403] rtc_cmos 00:05: RTC can wake from S4824gitlab # [ 6.604158] FDC 0 is a S82078B825gitlab # [ 6.606133] rtc_cmos 00:05: registered as rtc0826gitlab # [ 6.607812] rtc_cmos 00:05: setting system clock to 2026-10-04T11:32:44 UTC (1791113564)827gitlab # [ 6.612487] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6828gitlab # [ 6.618919] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs829gitlab # [ 6.516251] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 6.534351] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 6.539201] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 6.561038] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 6.567726] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.834gitlab # [ 6.568967] systemd[1]: Stopped Virtual Console Setup.835gitlab # [ 6.571922] systemd[1]: Starting Virtual Console Setup...836gitlab # [ 6.729621] ppdev: user-space parallel port driver837gitlab # [ 6.752668] kvm_amd: TSC scaling supported838gitlab # [ 6.753204] kvm_amd: Nested Virtualization enabled839gitlab # [ 6.753924] kvm_amd: Nested Paging enabled840gitlab # [ 6.754395] kvm_amd: LBR virtualization supported841gitlab # [ 6.755061] kvm_amd: Virtual VMLOAD VMSAVE supported842gitlab # [ 6.755765] kvm_amd: Virtual GIF supported843gitlab # [ 6.756263] kvm_amd: Virtual NMI enabled844gitlab # [ 6.793612] EDAC MC: Ver: 3.0.0845gitlab # [ 6.654628] systemd-vconsole-setup[493]: Configuration of first virtual console was skipped, ignoring remaining ones.846gitlab # [ 6.657465] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 6.897774] systemd[1]: Mounting /run/wrappers...848gitlab # [ 6.929776] systemd[1]: Mounted /run/wrappers.849gitlab # [ 6.931830] systemd[1]: Reached target Local File Systems.850gitlab # [ 6.933757] systemd[1]: Listening on Boot Loader Control Service Socket.851gitlab # [ 6.936306] systemd[1]: Starting register-nix-paths.service...852gitlab # [ 6.938690] systemd[1]: Starting Create SUID/SGID Wrappers...853gitlab # [ 6.940713] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.854gitlab # [ 6.943693] systemd[1]: Starting Save Transient machine-id to Disk...855gitlab # [ 6.953445] systemd[1]: Starting Create System Files and Directories...856gitlab # [ 6.990921] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.857gitlab # [ 6.994317] systemd[1]: Finished Save Transient machine-id to Disk.858gitlab # [ 7.005286] systemd[1]: Finished Create System Files and Directories.859gitlab # [ 7.009636] systemd[1]: Starting Rebuild Journal Catalog...860gitlab # [ 7.011630] systemd[1]: Starting Record System Boot/Shutdown in UTMP...861gitlab # [ 7.034460] systemd[1]: Finished Record System Boot/Shutdown in UTMP.862gitlab # [ 7.051282] systemd[1]: Finished Rebuild Journal Catalog.863gitlab # [ 7.053131] systemd[1]: Starting Update is Completed...864gitlab # [ 7.068893] systemd[1]: Finished Update is Completed.865gitlab # [ 7.098124] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.866gitlab # [ 7.099410] systemd[1]: Finished Create SUID/SGID Wrappers.867gitlab # [ 7.375704] systemd[1]: Finished register-nix-paths.service.868gitlab # [ 7.378083] systemd[1]: Reached target System Initialization.869gitlab # [ 7.380269] systemd[1]: Started Discard unused filesystem blocks once a week.870gitlab # [ 7.382852] systemd[1]: Started logrotate.timer.871gitlab # [ 7.384725] systemd[1]: Started Daily Cleanup of Temporary Directories.872gitlab # [ 7.387221] systemd[1]: Reached target Timer Units.873gitlab # [ 7.389138] systemd[1]: Listening on D-Bus System Message Bus Socket.874gitlab # [ 7.391396] systemd[1]: Listening on Nix Daemon Socket.875gitlab # [ 7.393388] systemd[1]: Starting nixbot CI service socket...876gitlab # [ 7.395449] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.877gitlab # [ 7.398436] systemd[1]: Listening on nixbot CI service socket.878gitlab # [ 7.400554] systemd[1]: Reached target Socket Units.879gitlab # [ 7.402447] systemd[1]: Starting D-Bus System Message Bus...880gitlab # [ 7.481719] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...881gitlab # [ 7.485192] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'882gitlab # [ 7.488204] dbus-broker-launch[575]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"883gitlab # [ 7.493856] systemd[1]: Started D-Bus System Message Bus.884gitlab # [ 7.511225] dbus-broker-launch[575]: Ready885gitlab # [ 7.515453] systemd[1]: Reached target Basic System.886gitlab # [ 7.518527] systemd[1]: Started backdoor.service.887gitlab # [ 7.521683] systemd[1]: Starting gitlab-config.service...888gitlab # [ 7.525686] systemd[1]: Starting Import lastlog data into lastlog2 database...889gitlab # [ 7.538498] systemd[1]: Starting Logrotate configuration check...890gitlab # [ 7.548448] systemd[1]: Starting Name Service Cache Daemon (nsncd)...891gitlab # [ 7.559092] systemd[1]: Starting Post-Boot Actions...892gitlab # [ 7.566171] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.571576] systemd[1]: Starting resolvconf update...894gitlab # connecting to host...895gitlab # [ 7.579373] logrotate[580]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.896gitlab # [ 7.580174] logrotate[580]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf897gitlab # [ 7.581148] logrotate[580]: note: 'monthly' overrides previously specified 'weekly'898gitlab # [ 7.583432] logrotate[580]: Reading state from file: /var/lib/logrotate.status899gitlab # [ 7.585073] logrotate[580]: state file /var/lib/logrotate.status does not exist900gitlab # [ 7.587092] logrotate[580]: Allocating hash table for state file, size 64 entries901gitlab # [ 7.587722] logrotate[580]: Handling 4 logs902gitlab # [ 7.591970] logrotate[580]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed903gitlab # [ 7.592624] logrotate[580]: considering log /var/log/btmp904gitlab # [ 7.593247] logrotate[580]: Creating new state905gitlab # [ 7.593691] logrotate[580]: Now: 2026-10-04 11:32906gitlab # [ 7.594247] logrotate[580]: Last rotated at 2026-10-04 11:00907gitlab # [ 7.594822] logrotate[580]: log does not need rotating (log has already been rotated)908gitlab # [ 7.596475] logrotate[580]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed909gitlab # [ 7.597032] logrotate[580]: considering log /var/log/wtmp910gitlab # [ 7.597524] logrotate[580]: Creating new state911gitlab # [ 7.598050] logrotate[580]: Now: 2026-10-04 11:32912gitlab # [ 7.598557] logrotate[580]: Last rotated at 2026-10-04 11:00913gitlab # [ 7.602067] logrotate[580]: log does not need rotating (log has already been rotated)914gitlab # [ 7.602699] logrotate[580]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed915gitlab # [ 7.603264] logrotate[580]: switching euid from 0 to 165 and egid from 0 to 165 (pid 580)916gitlab # [ 7.603750] logrotate[580]: considering log /var/gitlab/state/log/*.log917gitlab # [ 7.604458] logrotate[580]: log /var/gitlab/state/log/*.log does not exist -- skipping918gitlab # [ 7.607526] logrotate[580]: Creating new state919gitlab: Guest shell says: b'Spawning backdoor root shell...\n'920gitlab: connected to guest root shell921gitlab # [ 7.610453] logrotate[580]: switching euid from 165 to 0 and egid from 165 to 0 (pid 580)922gitlab: (connecting took 8.26 seconds)923gitlab # [ 7.610915] logrotate[580]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed924gitlab: (finished: waiting for the VM to finish booting, in 8.26 seconds)925gitlab # [ 7.611513] logrotate[580]: switching euid from 0 to 60 and egid from 0 to 60 (pid 580)926gitlab # [ 7.612606] logrotate[580]: considering log /var/log/nginx/*.log927gitlab # [ 7.613548] logrotate[580]: log /var/log/nginx/*.log does not exist -- skipping928gitlab # [ 7.616610] logrotate[580]: Creating new state929gitlab # [ 7.617230] logrotate[580]: not running postrotate script, since no logs were rotated930gitlab # [ 7.617768] logrotate[580]: switching euid from 60 to 0 and egid from 60 to 0 (pid 580)931gitlab # [ 7.619397] nsncd[581]: Oct 04 11:32:45.647 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"932gitlab # [ 7.621203] systemd[1]: Finished Logrotate configuration check.933gitlab # [ 7.621983] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 7.623850] systemd[1]: Finished Import lastlog data into lastlog2 database.935gitlab # [ 7.624630] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 7.626123] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 7.626783] systemd[1]: Starting User Login Management...938gitlab # [ 7.627853] systemd[1]: Finished Post-Boot Actions.939gitlab # [ 7.665647] systemd-logind[612]: New seat seat0.940gitlab # [ 7.667987] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.669084] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.672488] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.675620] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.676589] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.677696] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.678727] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.679672] systemd[1]: nscd.service: Consumed 31ms CPU time over 124ms wall clock time, 7.3M memory peak, 5.5M read from disk.948gitlab # [ 7.681352] systemd-logind[612]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 7.682570] systemd-logind[612]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)950gitlab # [ 7.683940] systemd-logind[612]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)951gitlab # [ 7.685297] systemd[1]: Started User Login Management.952gitlab # [ 7.686089] systemd[1]: Starting linger-users.service...953gitlab # [ 7.687035] systemd[1]: Starting Name Service Cache Daemon (nsncd)...954gitlab # [ 7.700089] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 7.701118] nsncd[673]: Oct 04 11:32:45.740 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.701852] systemd[1]: linger-users.service: Deactivated successfully.957gitlab # [ 7.702786] systemd[1]: Finished linger-users.service.958gitlab # [ 7.705432] systemd[1]: Reached target Host and Network Name Lookups.959gitlab # [ 7.706587] systemd[1]: Reached target User and Group Name Lookups.960gitlab # [ 7.709701] systemd[1]: Finished resolvconf update.961gitlab # [ 7.710582] systemd[1]: Reached target Preparation for Network.962gitlab # [ 7.712925] systemd[1]: Starting DHCP Client...963gitlab # [ 7.715165] systemd[1]: Starting Address configuration of eth1...964gitlab # [ 7.716929] systemd[1]: Starting Extra networking commands....965gitlab # [ 7.748679] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done966gitlab # [ 7.752722] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done967gitlab # [ 7.759194] systemd[1]: Finished Address configuration of eth1.968gitlab # [ 7.788104] dhcpcd[708]: dhcpcd-10.3.2 starting969gitlab # [ 7.789493] systemd[1]: Finished Extra networking commands..970gitlab # [ 7.790579] systemd[1]: Reached target Network.971gitlab # [ 7.791760] dhcpcd[765]: dev: loaded udev972gitlab # [ 7.792574] systemd[1]: Starting gitlab-workhorse.service...973gitlab # [ 7.942439] 8021q: 802.1Q VLAN Support v1.8974gitlab # [ 7.795233] systemd[1]: Start[ 7.943345] 8021q: adding VLAN 0 to HW filter on device eth1975gitlab # ing Nginx Web Server...976gitlab # [ 7.799942] systemd[1]: Starting PostgreSQL Server...977gitlab # [ 7.805325] systemd[1]: Starting Redis Server - redis-gitlab...978gitlab # [ 7.807565] systemd[1]: Starting Permit User Sessions...979gitlab # [ 7.818875] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.980gitlab # [ 7.828695] systemd[1]: Finished Permit User Sessions.981gitlab # [ 7.837629] systemd[1]: Started Getty on tty1.982gitlab # [ 7.839104] systemd[1]: Reached target Login Prompts.983gitlab # [ 8.036549] cfg80211: Loading compiled-in X.509 certificates for regulatory database984gitlab # [ 8.043036] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'985gitlab # [ 8.044318] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'986gitlab # [ 8.046211] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2987gitlab # [ 8.047543] cfg80211: failed to load regulatory.db988gitlab # [ 8.077774] 8021q: adding VLAN 0 to HW filter on device eth0989gitlab # [ 7.934767] dhcpcd[765]: eth0: waiting for carrier990gitlab # [ 7.936148] dhcpcd[765]: eth0: carrier acquired991gitlab # [ 7.943830] dhcpcd[765]: DUID 00:01:00:01:32:54:f5:dd:52:54:00:12:34:56992gitlab # [ 7.944531] dhcpcd[765]: eth0: IAID 00:12:34:56993gitlab # [ 7.945074] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456994gitlab # [ 7.952813] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok995gitlab # [ 7.954082] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful996gitlab # [ 7.962500] systemd[1]: Started Nginx Web Server.997gitlab # [ 7.963623] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.998gitlab # [ 7.968253] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo999gitlab # [ 7.968938] systemd[1]: Started Redis Server - redis-gitlab.1000gitlab # [ 7.969661] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started1001gitlab # [ 7.970199] redis-server[788]: Configuration loaded1002gitlab # [ 7.970667] redis[788]: monotonic clock: POSIX clock_gettime1003gitlab # [ 7.971563] redis[788]: Running mode=standalone, port=0.1004gitlab # [ 7.971924] redis[788]: Server initialized1005gitlab # [ 7.972594] redis[788]: Ready to accept connections unix1006gitlab # [ 7.973196] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1007gitlab # [ 7.975362] postgresql-pre-start[797]: The files belonging to this database system will be owned by user "postgres".1008gitlab # [ 7.976560] postgresql-pre-start[797]: This user must also own the server process.1009gitlab # [ 7.979948] postgresql-pre-start[797]: The database cluster will be initialized with locale "en_US.UTF-8".1010gitlab # [ 7.980640] postgresql-pre-start[797]: The default database encoding has accordingly been set to "UTF8".1011gitlab # [ 7.981173] postgresql-pre-start[797]: The default text search configuration will be set to "english".1012gitlab # [ 7.981664] postgresql-pre-start[797]: Data page checksums are enabled.1013gitlab # [ 7.982339] postgresql-pre-start[797]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1014gitlab # [ 7.982755] postgresql-pre-start[797]: creating subdirectories ... ok1015gitlab # [ 7.983469] postgresql-pre-start[797]: selecting dynamic shared memory implementation ... posix1016gitlab # [ 8.019241] postgresql-pre-start[797]: selecting default "max_connections" ... 1001017gitlab # [ 8.057891] postgresql-pre-start[797]: selecting default "shared_buffers" ... 128MB1018gitlab # [ 8.378960] systemd[1]: Started gitlab-workhorse.service.1019gitlab # [ 8.501942] postgresql-pre-start[797]: selecting default time zone ... UTC1020gitlab # [ 8.504469] postgresql-pre-start[797]: creating configuration files ... ok1021gitlab # [ 8.632556] gitlab-workhorse[824]: time="2026-10-04T11:32:46Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41022gitlab # [ 8.633534] gitlab-workhorse[824]: time="2026-10-04T11:32:46Z" level=info msg="Using redis/go-redis"1023gitlab # [ 8.634239] gitlab-workhorse[824]: time="2026-10-04T11:32:46Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1024gitlab # [ 8.700041] postgresql-pre-start[797]: running bootstrap script ... ok1025gitlab # [ 9.150643] postgresql-pre-start[797]: performing post-bootstrap initialization ... ok1026gitlab # [ 9.426170] postgresql-pre-start[797]: syncing data to disk ... ok1027gitlab # [ 9.427383] postgresql-pre-start[797]: initdb: warning: enabling "trust" authentication for local connections1028gitlab # [ 9.428334] postgresql-pre-start[797]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1029gitlab # [ 9.429055] postgresql-pre-start[797]: Success. You can now start the database server using:1030gitlab # [ 9.429731] postgresql-pre-start[797]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1031gitlab # [ 9.501209] dhcpcd[765]: eth0: soliciting a DHCP lease1032gitlab # [ 9.659643] NET: Registered PF_PACKET protocol family1033gitlab # [ 9.528272] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21034gitlab # [ 9.534529] dhcpcd[765]: eth0: probing address 10.0.2.15/241035gitlab # [ 9.554362] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1036gitlab # [ 9.556496] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321037gitlab # [ 9.557747] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321038gitlab # [ 9.562480] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1039gitlab # [ 9.575820] postgres[861]: [861] LOG: database system was shut down at 2026-10-04 11:32:47 GMT1040gitlab # [ 9.585037] postgres[850]: [850] LOG: database system is ready to accept connections1041gitlab # [ 9.591982] systemd[1]: Started PostgreSQL Server.1042gitlab # [ 9.593545] dhcpcd[765]: eth0: soliciting an IPv6 router1043gitlab # [ 9.595362] dhcpcd[765]: eth0: Router Advertisement from fe80::21044gitlab # [ 9.597138] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641045gitlab # [ 9.597993] dhcpcd[765]: eth0: adding route to fec0::/641046gitlab # [ 9.599256] dhcpcd[765]: eth0: adding default route via fe80::21047gitlab # [ 9.601370] systemd[1]: Starting PostgreSQL Setup Scripts...1048gitlab # [ 9.772945] postgresql-setup-start[877]: CREATE DATABASE1049gitlab # [ 9.774132] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[869]: mkdir -p /var/gitlab/state/home/.ssh: OK1050gitlab # [ 9.779638] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[869]: chmod 700 /var/gitlab/state/home/.ssh: OK1051gitlab # [ 9.799064] postgresql-setup-start[895]: CREATE ROLE1052gitlab # [ 9.810935] postgresql-setup-start[898]: ALTER DATABASE1053gitlab # [ 9.829689] postgresql-setup-start[908]: CREATE ROLE1054gitlab # [ 9.832149] systemd[1]: Finished PostgreSQL Setup Scripts.1055gitlab # [ 9.832714] systemd[1]: Reached target PostgreSQL.1056gitlab # [ 9.834233] systemd[1]: Starting gitlab-postgresql.service...1057gitlab # [ 9.852762] systemd[1]: Finished gitlab-config.service.1058gitlab # [ 9.854902] systemd[1]: Started gitaly.service.1059gitlab # [ 9.856379] systemd[1]: Starting gitlab-db-config.service...1060gitlab # [ 9.940676] gitlab-postgresql-start[922]: CREATE DATABASE1061gitlab # [ 9.977881] gitlab-postgresql-start[927]: CREATE EXTENSION1062gitlab # [ 10.069587] gitlab-postgresql-start[929]: CREATE EXTENSION1063gitlab # [ 10.073104] systemd[1]: Finished gitlab-postgresql.service.1064gitlab # [ 10.385907] gitaly[914]: time="2026-10-04T11:32:48.424Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9141065gitlab # [ 10.387088] gitaly[914]: time="2026-10-04T11:32:48.425Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9141066gitlab # [ 10.387767] gitaly[914]: time="2026-10-04T11:32:48.425Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9141067gitlab # [ 10.392811] gitaly[914]: time="2026-10-04T11:32:48.425Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9141068gitlab # [ 10.393648] gitaly[914]: time="2026-10-04T11:32:48.425Z" level=info msg="Starting Gitaly" pid=914 version=1069gitlab # [ 10.571970] gitaly[914]: time="2026-10-04T11:32:48.611Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=185 pid=9141070gitlab # [ 10.574129] gitaly[914]: time="2026-10-04T11:32:48.611Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9141071gitlab # [ 10.575907] gitaly[914]: time="2026-10-04T11:32:48.612Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9141072gitlab # [ 10.577879] gitaly[914]: time="2026-10-04T11:32:48.612Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-914/git-exec-3561307669.d/git pid=9141073gitlab # [ 10.580152] gitaly[914]: time="2026-10-04T11:32:48.615Z" level=info msg="finished detecting git version" duration_ms=3 pid=9141074gitlab # [ 10.581907] gitaly[914]: time="2026-10-04T11:32:48.615Z" level=info msg="using Git version" pid=914 version=2.53.g1075gitlab # [ 10.583531] gitaly[914]: time="2026-10-04T11:32:48.616Z" level=info msg="clearing disk cache object folder" pid=914 storage=default1076gitlab # [ 10.585388] gitaly[914]: time="2026-10-04T11:32:48.616Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1503106441 pid=914 storage=default1077gitlab # [ 10.588270] gitaly[914]: time="2026-10-04T11:32:48.616Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1503106441 pid=914 storage=default1078gitlab # [ 10.591522] gitaly[914]: time="2026-10-04T11:32:48.616Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9141079gitlab # [ 10.594486] gitaly[914]: time="2026-10-04T11:32:48.616Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9141080gitlab # [ 10.597403] gitaly[914]: time="2026-10-04T11:32:48.617Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1503106441 clear_duration_ms=0 pid=914 storage=default1081gitlab # [ 10.621997] gitaly[914]: time="2026-10-04T11:32:48.661Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9141082gitlab # [ 10.624502] gitaly[914]: time="2026-10-04T11:32:48.661Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=914 schema=unix1083gitlab # [ 10.626811] gitaly[914]: time="2026-10-04T11:32:48.661Z" level=info msg="finished tempdir cleaner walk" pid=914 storage=default time_ms=01084gitlab # [ 10.628578] gitaly[914]: time="2026-10-04T11:32:48.661Z" level=info msg="listening at address" address=/run/gitaly/gitaly-914/sock.d/intern pid=914 schema=unix1085gitlab # [ 10.630682] gitaly[914]: time="2026-10-04T11:32:48.661Z" level=info msg="counting repositories" pid=9141086gitlab # [ 10.632233] gitaly[914]: time="2026-10-04T11:32:48.661Z" level=info msg="starting to count repositories" pid=914 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.634296] gitaly[914]: time="2026-10-04T11:32:48.662Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=914 storage_path=/var/gitlab/state/repositories1088gitlab # [ 10.636744] gitaly[914]: time="2026-10-04T11:32:48.662Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9141089gitlab # [ 10.638607] gitaly[914]: time="2026-10-04T11:32:48.663Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9141090gitlab # [ 10.640769] gitaly[914]: time="2026-10-04T11:32:48.663Z" level=info msg="Started Gitaly" duration_ms=237 pid=9141091gitlab # [ 10.641486] gitaly[914]: time="2026-10-04T11:32:48.663Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9141092gitlab # [ 10.642413] gitaly[914]: time="2026-10-04T11:32:48.663Z" level=info msg="maintenance: daily scheduled" pid=914 scheduled="2026-10-04 12:00:00 +0000 UTC"1093gitlab # [ 11.522414] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1094gitlab # [ 11.529080] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1095gitlab # [ 11.565642] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1096gitlab # [ 12.666291] gitaly[914]: time="2026-10-04T11:32:50.704Z" level=info msg="License database preloaded" duration_ms=2279 pid=9141097gitlab # [ 14.448431] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1098gitlab # [ 14.449098] dhcpcd[765]: eth0: adding route to 10.0.2.0/241099gitlab # [ 14.449494] dhcpcd[765]: eth0: adding default route via 10.0.2.21100gitlab # [ 14.555097] systemd[1]: Started DHCP Client.1101gitlab # [ 14.557087] systemd[1]: Reached target Network is Online.1102gitlab # [ 44.123413] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: W, [2026-10-04T11:33:22.162135 #921] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1103gitlab # [ 46.338949] postgres[1335]: [1335] ERROR: relation "feature_gates" does not exist at character 5231104gitlab # [ 46.340705] postgres[1335]: [1335] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1105gitlab # [ 46.342545] postgres[1335]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1106gitlab # [ 46.345340] postgres[1335]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1107gitlab # [ 46.347277] postgres[1335]: attidentity AS identity,1108gitlab # [ 46.349228] postgres[1335]: attgenerated as attgenerated1109gitlab # [ 46.351159] postgres[1335]: FROM pg_attribute a1110gitlab # [ 46.353099] postgres[1335]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1111gitlab # [ 46.355063] postgres[1335]: LEFT JOIN pg_type t ON a.atttypid = t.oid1112gitlab # [ 46.356955] postgres[1335]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1113gitlab # [ 46.359305] postgres[1335]: WHERE a.attrelid = '"feature_gates"'::regclass1114gitlab # [ 46.361231] postgres[1335]: AND a.attnum > 0 AND NOT a.attisdropped1115gitlab # [ 46.363210] postgres[1335]: ORDER BY a.attnum1116gitlab # [ 46.365126] postgres[1335]:1117gitlab # [ 48.694899] gitlab-workhorse[824]: time="2026-10-04T11:33:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 49.956797] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1377]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 49.958930] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1377]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 58.702990] gitlab-workhorse[824]: time="2026-10-04T11:33:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 65.689659] postgres[1443]: [1443] ERROR: relation "table_without_models" does not exist1122gitlab # [ 65.692174] postgres[1443]: [1443] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1123gitlab # [ 68.712267] gitlab-workhorse[824]: time="2026-10-04T11:33:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 78.174039] systemd[1]: Finished gitlab-db-config.service.1125gitlab # [ 78.177924] systemd[1]: Started gitlab-sidekiq.service.1126gitlab # [ 78.181108] systemd[1]: Starting gitlab.service...1127gitlab # [ 78.537334] bundle[1628]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1128gitlab # [ 78.538857] bundle[1628]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1129gitlab # [ 78.542500] bundle[1628]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1130gitlab # [ 78.722151] gitlab-workhorse[824]: time="2026-10-04T11:33:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1131gitlab # [ 81.463872] sidekiq-cluster[1627]: {"severity":"INFO","time":"2026-10-04T11:33:59.485Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 81.473204] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.488Z","pid":1628,"message":"* Enabling systemd notification integration"}1133gitlab # [ 81.474341] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"Puma starting in cluster mode..."}1134gitlab # [ 81.474998] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 81.475770] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 81.476693] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Min threads: 0"}1137gitlab # [ 81.477604] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Max threads: 4"}1138gitlab # [ 81.478376] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Environment: production"}1139gitlab # [ 81.479058] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Master PID: 1628"}1140gitlab # [ 81.479713] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Workers: 2"}1141gitlab # [ 81.480621] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 81.481285] bundle[1628]: {"timestamp":"2026-10-04T11:33:59.512Z","pid":1628,"message":"* Preloading application"}1143gitlab # [ 88.731648] gitlab-workhorse[824]: time="2026-10-04T11:34:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 98.738184] gitlab-workhorse[824]: time="2026-10-04T11:34:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 105.123367] bundle[1628]: W, [2026-10-04T11:34:23.162140 #1628] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 108.505552] sidekiq-cluster[1658]: 2026-10-04T11:34:26.543Z pid=1658 tid=wk2 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1658, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>443248640}1147gitlab # [ 108.685854] sidekiq-cluster[1658]: W, [2026-10-04T11:34:26.725354 #1658] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 108.747512] gitlab-workhorse[824]: time="2026-10-04T11:34:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1149gitlab # [ 108.749245] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:26.788Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 110.887087] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:28.925Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 110.889446] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:28.925Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 110.941933] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:28.981Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 110.950068] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:28.989Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 110.960705] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.000Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 110.970653] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.010Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 110.981098] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.020Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 110.991692] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.031Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 111.001112] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.040Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 111.009676] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.049Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 111.018096] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.057Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 111.026497] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.066Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 111.035879] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.075Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 111.045927] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.085Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 111.054576] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.094Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 111.063386] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.102Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 111.072745] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.112Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 111.081475] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.121Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 111.091359] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.130Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 111.101407] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.140Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 111.111643] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.151Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 111.121764] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.161Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 111.132214] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.171Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 111.142346] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.181Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 111.154364] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.193Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 111.160462] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.200Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 111.166777] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.206Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 111.174487] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.214Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 111.181486] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.221Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 111.188888] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.228Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 111.195714] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.235Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 111.202811] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.242Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 111.208172] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.247Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 111.214603] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.254Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 111.220362] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.259Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 111.226381] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.265Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 111.233273] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.272Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 111.238960] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.278Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 111.243278] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.282Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 111.249053] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.288Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 111.252633] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.292Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 111.256412] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.296Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 111.260498] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.300Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 111.263947] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.303Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 111.267366] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.307Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 111.270720] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.310Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 111.274245] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.313Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 111.277545] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.317Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 111.280679] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.320Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 111.283780] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.323Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 111.287243] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.326Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 111.290233] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.329Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 111.293485] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.333Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 111.297158] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.336Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 111.306644] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.346Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 111.310303] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.349Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 111.313643] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.353Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 111.317051] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.356Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 111.320074] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.359Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 111.323656] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.363Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 111.326527] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.366Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 111.329717] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.369Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 111.332672] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.372Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 111.335413] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.375Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 111.338278] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.377Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 111.340951] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.380Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 111.343530] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.383Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 111.346403] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.386Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 111.348591] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.388Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 111.350854] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.390Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 111.353208] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.392Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 111.355638] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.395Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 111.358239] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.397Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 111.360402] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.400Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 111.362552] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.402Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 111.364797] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.404Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 111.367029] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.406Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 111.369188] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.408Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 111.371671] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.411Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 111.374111] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.413Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 111.376576] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.416Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 111.378633] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.418Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 111.381450] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.421Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 111.383579] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.423Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 111.386859] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.426Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 111.389366] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.429Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 111.392188] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.431Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 111.394343] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.433Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 111.397121] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.436Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 111.399536] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.439Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 111.401615] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.441Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 111.403995] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.443Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 111.405856] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.445Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 111.408046] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.447Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 111.410396] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.450Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 111.412426] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.452Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 111.415361] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.455Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 111.418110] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.457Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 111.420505] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.460Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 111.422630] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.462Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 111.430618] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.470Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 111.433100] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.472Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 111.435199] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.474Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 111.438657] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.478Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 111.441741] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.481Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 111.444617] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.484Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 111.447976] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.487Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 111.450190] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.489Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 111.452628] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.492Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 111.455932] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.495Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 111.458365] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:29.498Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 114.180838] sidekiq-cluster[1658]: InitializerConnections Query: SET client_min_messages TO 'warning'1262gitlab # [ 114.181786] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1263gitlab # [ 114.182388] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1264gitlab # [ 114.182974] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1265gitlab # [ 114.183620] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1266gitlab # [ 114.184147] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1267gitlab # [ 114.184631] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1268gitlab # [ 114.188049] sidekiq-cluster[1658]: InitializerConnections Query: SET standard_conforming_strings = on1269gitlab # [ 114.188500] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1270gitlab # [ 114.188949] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1271gitlab # [ 114.189633] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1272gitlab # [ 114.190151] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1273gitlab # [ 114.190639] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1274gitlab # [ 114.191184] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1275gitlab # [ 114.195503] sidekiq-cluster[1658]: InitializerConnections Query: SET intervalstyle = iso_86011276gitlab # [ 114.196184] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1277gitlab # [ 114.196601] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1278gitlab # [ 114.197143] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1279gitlab # [ 114.197607] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1280gitlab # [ 114.198108] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1281gitlab # [ 114.198589] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1282gitlab # [ 114.203983] sidekiq-cluster[1658]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1283gitlab # [ 114.204609] sidekiq-cluster[1658]: FROM pg_type as t1284gitlab # [ 114.205178] sidekiq-cluster[1658]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1285gitlab # [ 114.205651] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1286gitlab # [ 114.206203] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1287gitlab # [ 114.206664] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1288gitlab # [ 114.207201] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1289gitlab # [ 114.207681] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1290gitlab # [ 114.208221] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1291gitlab # [ 114.211750] sidekiq-cluster[1658]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1292gitlab # [ 114.212483] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1293gitlab # [ 114.212945] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1294gitlab # [ 114.213573] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1295gitlab # [ 114.214077] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1296gitlab # [ 114.214571] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1297gitlab # [ 114.215126] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1298gitlab # [ 114.221322] sidekiq-cluster[1658]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1299gitlab # [ 114.221900] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1300gitlab # [ 114.222595] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1301gitlab # [ 114.223105] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1302gitlab # [ 114.223583] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1303gitlab # [ 114.224061] sidekiq-cluster[1658]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1304gitlab # [ 114.224535] sidekiq-cluster[1658]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1305gitlab # [ 118.759858] gitlab-workhorse[824]: time="2026-10-04T11:34:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1306gitlab # [ 128.761681] gitlab-workhorse[824]: time="2026-10-04T11:34:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1307gitlab # [ 133.010177] postgres[2133]: [2133] ERROR: relation "table_without_models" does not exist1308gitlab # [ 133.010608] postgres[2133]: [2133] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 133.769514] postgres[2144]: [2144] ERROR: relation "table_without_models" does not exist1310gitlab # [ 133.771536] postgres[2144]: [2144] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1311gitlab # [ 135.609912] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:53.645Z","message":"Booted Rails 7.2.3.1 application in production environment"}1312gitlab # [ 135.611939] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:53.648Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1313gitlab # [ 135.613369] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:53.648Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1314gitlab # [ 135.617153] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:53.648Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1315gitlab # [ 135.618363] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:53.649Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1316gitlab # [ 136.527893] bundle[1628]: {"timestamp":"2026-10-04T11:34:54.566Z","pid":1628,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1317gitlab # [ 136.529943] bundle[1628]: {"timestamp":"2026-10-04T11:34:54.566Z","pid":1628,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1318gitlab # [ 136.531480] bundle[1628]: {"timestamp":"2026-10-04T11:34:54.566Z","pid":1628,"message":"! #\u003cThread:0x0000721d47735240 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1319gitlab # [ 136.533119] bundle[1628]: {"timestamp":"2026-10-04T11:34:54.566Z","pid":1628,"message":"! #\u003cThread:0x0000721d47959710 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1320gitlab # [ 136.534181] bundle[1628]: {"timestamp":"2026-10-04T11:34:54.566Z","pid":1628,"message":"Use Ctrl-C to stop"}1321gitlab # [ 136.535359] bundle[1628]: {"timestamp":"2026-10-04T11:34:54.567Z","pid":1628,"message":"Sending status to systemd every 1.0 sec"}1322gitlab # [ 137.367972] bundle[1628]: {"timestamp":"2026-10-04T11:34:55.407Z","pid":1628,"message":"- Worker 1 (PID: 2195) booted in 0.76s, phase: 0"}1323gitlab # [ 137.449329] bundle[1628]: {"timestamp":"2026-10-04T11:34:55.488Z","pid":1628,"message":"- Worker 0 (PID: 2191) booted in 0.86s, phase: 0"}1324gitlab # [ 137.455984] systemd[1]: Started gitlab.service.1325gitlab # [ 137.456905] systemd[1]: Reached target Common target for all GitLab services..1326gitlab # [ 137.460449] systemd[1]: Starting setup-gitlab.service...1327gitlab # [ 137.480514] setup-gitlab-start[2228]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1328gitlab # [ 137.527689] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:55.566Z","message":"Cleaning working queues"}1329gitlab # [ 137.533435] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:55.572Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2898ba9ecf4202732f77ffe2","created_at":"2026-10-04T11:33:55.782Z","trace_propagation_headers":{"sentry-trace":"7d3659e4322a4f068705e8cdffd5feb4-a5899feb60514a63","baggage":"sentry-trace_id=7d3659e4322a4f068705e8cdffd5feb4,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"14a6d727f181d4c2de15e870ddd701f3","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T11:33:55.789Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2898ba9ecf4202732f77ffe2: start","job_status":"start","queue_duration_s":59.782431,"scheduling_latency_s":59.782529}1330gitlab # [ 137.726755] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:34:55.766Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2898ba9ecf4202732f77ffe2","created_at":"2026-10-04T11:33:55.782Z","trace_propagation_headers":{"sentry-trace":"7d3659e4322a4f068705e8cdffd5feb4-a5899feb60514a63","baggage":"sentry-trace_id=7d3659e4322a4f068705e8cdffd5feb4,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"14a6d727f181d4c2de15e870ddd701f3","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T11:33:55.789Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2898ba9ecf4202732f77ffe2: done: 0.193878 sec","job_status":"done","queue_duration_s":59.782431,"scheduling_latency_s":59.782529,"redis_calls":26,"redis_duration_s":0.007132,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004537,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001516,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09013603599999999,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.193878,"completed_at":"2026-10-04T11:34:55.765Z","load_balancing_strategy":"primary","db_duration_s":0.042244,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1331gitlab # [ 139.892196] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:34:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23781332gitlab # [ 139.897702] setup-gitlab-start[2228]: + TOKEN=nixbot-test-token-of-20-chars1333gitlab # [ 139.900290] setup-gitlab-start[2228]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1334gitlab # [ 139.919375] runuser[2257]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1335gitlab # [ 140.314719] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1336gitlab # [ 140.316399] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1337gitlab # [ 140.317572] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1338gitlab # [ 140.895864] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1339gitlab # [ 140.897611] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1340gitlab # [ 140.898750] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1341gitlab # [ 150.268110] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"45397065ffd6b8238411d8fe","created_at":"2026-10-04T11:35:08.269Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dddf7e4b4a701e017f2dda45a7583868","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.303Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-45397065ffd6b8238411d8fe: start","job_status":"start","queue_duration_s":0.003133,"scheduling_latency_s":0.003192}1342gitlab # [ 150.343604] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.383Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1343gitlab # [ 150.364209] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"45397065ffd6b8238411d8fe","created_at":"2026-10-04T11:35:08.269Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dddf7e4b4a701e017f2dda45a7583868","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.303Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-45397065ffd6b8238411d8fe: done: 0.09702 sec","job_status":"done","queue_duration_s":0.003133,"scheduling_latency_s":0.003192,"redis_calls":10,"redis_duration_s":0.010924,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003013,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002261181,"duration_s":0.09702,"completed_at":"2026-10-04T11:35:08.403Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 150.435439] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b66a1ac836fc31216d39800c","created_at":"2026-10-04T11:35:08.350Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.368Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b66a1ac836fc31216d39800c: start","job_status":"start","queue_duration_s":0.105701,"scheduling_latency_s":0.105755}1345gitlab # [ 150.537832] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b66a1ac836fc31216d39800c","created_at":"2026-10-04T11:35:08.350Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.368Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b66a1ac836fc31216d39800c: done: 0.102446 sec","job_status":"done","queue_duration_s":0.105701,"scheduling_latency_s":0.105755,"redis_calls":19,"redis_duration_s":0.02183,"redis_read_bytes":21,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003326,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.007499,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.009244,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001008229,"duration_s":0.102446,"completed_at":"2026-10-04T11:35:08.576Z","load_balancing_strategy":"primary","db_duration_s":0.008896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 150.546413] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5d4ff761664dc5cc6cc7f1d3","created_at":"2026-10-04T11:35:08.380Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ecbb3c64e679eed347d5314f997f9d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-04T11:35:08.390Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5d4ff761664dc5cc6cc7f1d3: start","job_status":"start","queue_duration_s":0.194924,"scheduling_latency_s":0.194978}1347gitlab # [ 150.593238] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.632Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1348gitlab # [ 150.608388] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5d4ff761664dc5cc6cc7f1d3","created_at":"2026-10-04T11:35:08.380Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ecbb3c64e679eed347d5314f997f9d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-04T11:35:08.390Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5d4ff761664dc5cc6cc7f1d3: done: 0.06196 sec","job_status":"done","queue_duration_s":0.194924,"scheduling_latency_s":0.194978,"redis_calls":10,"redis_duration_s":0.008872999999999999,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001907,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002597,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001596571,"duration_s":0.06196,"completed_at":"2026-10-04T11:35:08.647Z","load_balancing_strategy":"primary","db_duration_s":0.009458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 150.613851] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fdd3762a4525b93c35f0b338","created_at":"2026-10-04T11:35:08.468Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4be0056ba7ce82efe6958fb6301b423","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.516Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fdd3762a4525b93c35f0b338: start","job_status":"start","queue_duration_s":0.136549,"scheduling_latency_s":0.136576}1350gitlab # [ 150.702470] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fdd3762a4525b93c35f0b338","created_at":"2026-10-04T11:35:08.468Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4be0056ba7ce82efe6958fb6301b423","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.516Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fdd3762a4525b93c35f0b338: done: 0.088798 sec","job_status":"done","queue_duration_s":0.136549,"scheduling_latency_s":0.136576,"redis_calls":14,"redis_duration_s":0.005163,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000630527,"exclusive_lock_hold_duration_s":0.067394878,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.088798,"completed_at":"2026-10-04T11:35:08.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 150.745992] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.785Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"459b1e8360e7e826b9a545cb","created_at":"2026-10-04T11:35:08.529Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f39213293b2f8ef0b16630c5891eb0b0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.547Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-459b1e8360e7e826b9a545cb: start","job_status":"start","queue_duration_s":0.238147,"scheduling_latency_s":0.23818}1352gitlab # [ 150.829275] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"459b1e8360e7e826b9a545cb","created_at":"2026-10-04T11:35:08.529Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f39213293b2f8ef0b16630c5891eb0b0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.547Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-459b1e8360e7e826b9a545cb: done: 0.0833 sec","job_status":"done","queue_duration_s":0.238147,"scheduling_latency_s":0.23818,"redis_calls":10,"redis_duration_s":0.026434999999999997,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.01928,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000293612,"duration_s":0.0833,"completed_at":"2026-10-04T11:35:08.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 150.894966] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.934Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ddafdd3c6c1a6de1f6070b6","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ddafdd3c6c1a6de1f6070b6: start","job_status":"start","queue_duration_s":0.379509,"scheduling_latency_s":0.379544}1354gitlab # [ 150.929978] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.969Z","message":"No existing merge request to be cleaned up."}1355gitlab # [ 150.955273] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.994Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ddafdd3c6c1a6de1f6070b6","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ddafdd3c6c1a6de1f6070b6: done: 0.060027 sec","job_status":"done","queue_duration_s":0.379509,"scheduling_latency_s":0.379544,"redis_calls":13,"redis_duration_s":0.017761,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000495,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004328,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.012938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001000127,"duration_s":0.060027,"completed_at":"2026-10-04T11:35:08.994Z","load_balancing_strategy":"primary","db_duration_s":0.013253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 150.977294] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:08.999Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0245905dab9791e326594233","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0245905dab9791e326594233: start","job_status":"start","queue_duration_s":0.444856,"scheduling_latency_s":0.444897}1357gitlab # [ 150.981927] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.021Z","message":"No existing merge request to be cleaned up."}1358gitlab # [ 150.988961] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.028Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0245905dab9791e326594233","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0245905dab9791e326594233: done: 0.028929 sec","job_status":"done","queue_duration_s":0.444856,"scheduling_latency_s":0.444897,"redis_calls":10,"redis_duration_s":0.00551,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002468,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028929,"completed_at":"2026-10-04T11:35:09.028Z","load_balancing_strategy":"primary","db_duration_s":0.002085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 151.001408] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.029Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dfd42efffce65bf695e9f343","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dfd42efffce65bf695e9f343: start","job_status":"start","queue_duration_s":0.474663,"scheduling_latency_s":0.474682}1360gitlab # [ 151.013150] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.039Z","message":"No existing merge request to be cleaned up."}1361gitlab # [ 151.014841] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.044Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dfd42efffce65bf695e9f343","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dfd42efffce65bf695e9f343: done: 0.015299 sec","job_status":"done","queue_duration_s":0.474663,"scheduling_latency_s":0.474682,"redis_calls":10,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015299,"completed_at":"2026-10-04T11:35:09.044Z","load_balancing_strategy":"primary","db_duration_s":0.003945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 151.069516] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.046Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a11c7ebb4fe41a4c54e12505","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a11c7ebb4fe41a4c54e12505: start","job_status":"start","queue_duration_s":0.491341,"scheduling_latency_s":0.491356}1363gitlab # [ 151.070310] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.054Z","message":"No existing merge request to be cleaned up."}1364gitlab # [ 151.071172] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.060Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a11c7ebb4fe41a4c54e12505","created_at":"2026-10-04T11:35:08.518Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-47ce07732dfd4ce6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3f2b0181bfe59bbeb038c6a19c8437ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.554Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a11c7ebb4fe41a4c54e12505: done: 0.013943 sec","job_status":"done","queue_duration_s":0.491341,"scheduling_latency_s":0.491356,"redis_calls":10,"redis_duration_s":0.001498,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013943,"completed_at":"2026-10-04T11:35:09.060Z","load_balancing_strategy":"primary","db_duration_s":0.003391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 151.099025] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"f0cc6f774f0058fcfe70a6aa","created_at":"2026-10-04T11:35:08.564Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e4b28a502ef4bd58ac3ceda15760d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.575Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-f0cc6f774f0058fcfe70a6aa: start","job_status":"start","queue_duration_s":0.485523,"scheduling_latency_s":0.485538}1366gitlab # [ 151.129775] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"f0cc6f774f0058fcfe70a6aa","created_at":"2026-10-04T11:35:08.564Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e4b28a502ef4bd58ac3ceda15760d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.575Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-f0cc6f774f0058fcfe70a6aa: done: 0.107928 sec","job_status":"done","queue_duration_s":0.485523,"scheduling_latency_s":0.485538,"redis_calls":12,"redis_duration_s":0.0020800000000000003,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000396698,"exclusive_lock_hold_duration_s":0.091657459,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.107928,"completed_at":"2026-10-04T11:35:09.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011043,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1367gitlab # [ 151.176857] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"384e92f44aaca4760bd76b9b","created_at":"2026-10-04T11:35:08.583Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5f414b37b6458723ad9a5f01d8db27a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.594Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-384e92f44aaca4760bd76b9b: start","job_status":"start","queue_duration_s":0.576412,"scheduling_latency_s":0.576428}1368gitlab # [ 151.177677] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"384e92f44aaca4760bd76b9b","created_at":"2026-10-04T11:35:08.583Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5f414b37b6458723ad9a5f01d8db27a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.594Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-384e92f44aaca4760bd76b9b: done: 0.032179 sec","job_status":"done","queue_duration_s":0.576412,"scheduling_latency_s":0.576428,"redis_calls":12,"redis_duration_s":0.0018830000000000001,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000413181,"exclusive_lock_hold_duration_s":0.008564217,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032179,"completed_at":"2026-10-04T11:35:09.202Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 151.209774] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a6968aa476bc93d675afd095","created_at":"2026-10-04T11:35:08.596Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7f26b276b05d2f79c45d0d31853529f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.610Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a6968aa476bc93d675afd095: start","job_status":"start","queue_duration_s":0.593442,"scheduling_latency_s":0.593458}1370gitlab # [ 151.254843] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.211Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1371gitlab # [ 151.255644] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a6968aa476bc93d675afd095","created_at":"2026-10-04T11:35:08.596Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7f26b276b05d2f79c45d0d31853529f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.610Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a6968aa476bc93d675afd095: done: 0.012996 sec","job_status":"done","queue_duration_s":0.593442,"scheduling_latency_s":0.593458,"redis_calls":10,"redis_duration_s":0.001296,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208127,"duration_s":0.012996,"completed_at":"2026-10-04T11:35:09.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 151.300760] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"278d8dddb1d5bff9313b9d0b","created_at":"2026-10-04T11:35:08.625Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99c95aea08b0197be9d75145e7f11abd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.638Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-278d8dddb1d5bff9313b9d0b: start","job_status":"start","queue_duration_s":0.579334,"scheduling_latency_s":0.579348}1373gitlab # [ 151.301589] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"278d8dddb1d5bff9313b9d0b","created_at":"2026-10-04T11:35:08.625Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99c95aea08b0197be9d75145e7f11abd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.638Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-278d8dddb1d5bff9313b9d0b: done: 0.020234 sec","job_status":"done","queue_duration_s":0.579334,"scheduling_latency_s":0.579348,"redis_calls":17,"redis_duration_s":0.002398,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.0011,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00024,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218463,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.020234,"completed_at":"2026-10-04T11:35:09.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 151.342755] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b15eb858628351f7397d1519","created_at":"2026-10-04T11:35:08.649Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85600cb43f3fa018f3db8862f980090f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.695Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b15eb858628351f7397d1519: start","job_status":"start","queue_duration_s":0.543841,"scheduling_latency_s":0.543854}1375gitlab # [ 151.343525] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b15eb858628351f7397d1519","created_at":"2026-10-04T11:35:08.649Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85600cb43f3fa018f3db8862f980090f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.695Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b15eb858628351f7397d1519: done: 0.015611 sec","job_status":"done","queue_duration_s":0.543841,"scheduling_latency_s":0.543854,"redis_calls":12,"redis_duration_s":0.001904,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223213,"duration_s":0.015611,"completed_at":"2026-10-04T11:35:09.254Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 151.372477] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c233ca128a127249b7c4f2b2","created_at":"2026-10-04T11:35:08.714Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"303fe2bf14d720267873246786668378","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.723Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c233ca128a127249b7c4f2b2: start","job_status":"start","queue_duration_s":0.532485,"scheduling_latency_s":0.5325}1377gitlab # [ 151.418417] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.264Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1378gitlab # [ 151.419152] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c233ca128a127249b7c4f2b2","created_at":"2026-10-04T11:35:08.714Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"303fe2bf14d720267873246786668378","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.723Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c233ca128a127249b7c4f2b2: done: 0.012925 sec","job_status":"done","queue_duration_s":0.532485,"scheduling_latency_s":0.5325,"redis_calls":10,"redis_duration_s":0.001721,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217346,"duration_s":0.012925,"completed_at":"2026-10-04T11:35:09.268Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 151.428104] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"95076bdd9e77a7cdf2854d96","created_at":"2026-10-04T11:35:08.731Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5253c3577835ee7d71b3fba1389c8d91","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.740Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-95076bdd9e77a7cdf2854d96: start","job_status":"start","queue_duration_s":0.529778,"scheduling_latency_s":0.529792}1380gitlab # [ 151.479134] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.288Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"95076bdd9e77a7cdf2854d96","created_at":"2026-10-04T11:35:08.731Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5253c3577835ee7d71b3fba1389c8d91","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.740Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-95076bdd9e77a7cdf2854d96: done: 0.01868 sec","job_status":"done","queue_duration_s":0.529778,"scheduling_latency_s":0.529792,"redis_calls":10,"redis_duration_s":0.001335,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020701,"duration_s":0.01868,"completed_at":"2026-10-04T11:35:09.288Z","load_balancing_strategy":"primary","db_duration_s":0.00243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 151.480230] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bff748b8591c998b4225c730","created_at":"2026-10-04T11:35:08.799Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.819Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bff748b8591c998b4225c730: start","job_status":"start","queue_duration_s":0.470504,"scheduling_latency_s":0.470516}1382gitlab # [ 151.523659] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bff748b8591c998b4225c730","created_at":"2026-10-04T11:35:08.799Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.819Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bff748b8591c998b4225c730: done: 0.074895 sec","job_status":"done","queue_duration_s":0.470504,"scheduling_latency_s":0.470516,"redis_calls":71,"redis_duration_s":0.014167,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001701,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000593,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.011459,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267911,"duration_s":0.074895,"completed_at":"2026-10-04T11:35:09.364Z","load_balancing_strategy":"primary","db_duration_s":0.001483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 151.531717] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3754624e27c304f09b590f50","created_at":"2026-10-04T11:35:08.851Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5853a4abd1982c198c7df8b95d4acbde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.860Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3754624e27c304f09b590f50: start","job_status":"start","queue_duration_s":0.505728,"scheduling_latency_s":0.505745}1384gitlab # [ 151.580702] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"3754624e27c304f09b590f50","created_at":"2026-10-04T11:35:08.851Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5853a4abd1982c198c7df8b95d4acbde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.860Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-3754624e27c304f09b590f50: done: 0.154198 sec","job_status":"done","queue_duration_s":0.505728,"scheduling_latency_s":0.505745,"redis_calls":12,"redis_duration_s":0.001892,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000338869,"exclusive_lock_hold_duration_s":0.138071739,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.154198,"completed_at":"2026-10-04T11:35:09.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 151.583316] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"99f1b456c3ba5c900aae474f","created_at":"2026-10-04T11:35:08.930Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ad9df63cda66004a3c1a016bf1f0aa6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.940Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-99f1b456c3ba5c900aae474f: start","job_status":"start","queue_duration_s":0.581167,"scheduling_latency_s":0.581185}1386gitlab # [ 151.597129] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"99f1b456c3ba5c900aae474f","created_at":"2026-10-04T11:35:08.930Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ad9df63cda66004a3c1a016bf1f0aa6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.940Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-99f1b456c3ba5c900aae474f: done: 0.014622 sec","job_status":"done","queue_duration_s":0.581167,"scheduling_latency_s":0.581185,"redis_calls":10,"redis_duration_s":0.0014969999999999998,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209803,"duration_s":0.014622,"completed_at":"2026-10-04T11:35:09.535Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 151.645193] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d3b261f7e86ef0887388128f","created_at":"2026-10-04T11:35:08.961Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e393d25155133f91820062da323ef4a2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.975Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d3b261f7e86ef0887388128f: start","job_status":"start","queue_duration_s":0.561773,"scheduling_latency_s":0.561787}1388gitlab # [ 151.789762] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"d3b261f7e86ef0887388128f","created_at":"2026-10-04T11:35:08.961Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e393d25155133f91820062da323ef4a2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.975Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-d3b261f7e86ef0887388128f: done: 0.292063 sec","job_status":"done","queue_duration_s":0.561773,"scheduling_latency_s":0.561787,"redis_calls":565,"redis_duration_s":0.11268900000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.110337,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000754565,"duration_s":0.292063,"completed_at":"2026-10-04T11:35:09.828Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 151.793782] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fa1477434440d88ae313d959","created_at":"2026-10-04T11:35:08.988Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f84d5ed570fe769ec6093056880f71b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.997Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fa1477434440d88ae313d959: start","job_status":"start","queue_duration_s":0.836312,"scheduling_latency_s":0.83633}1390gitlab # [ 151.840961] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.843Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1391gitlab # [ 151.841815] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fa1477434440d88ae313d959","created_at":"2026-10-04T11:35:08.988Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f84d5ed570fe769ec6093056880f71b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:08.997Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fa1477434440d88ae313d959: done: 0.01539 sec","job_status":"done","queue_duration_s":0.836312,"scheduling_latency_s":0.83633,"redis_calls":10,"redis_duration_s":0.0016929999999999998,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203099,"duration_s":0.01539,"completed_at":"2026-10-04T11:35:09.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 151.850897] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"205858d0feabab0c3cd53f8c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-205858d0feabab0c3cd53f8c: start","job_status":"start","queue_duration_s":0.492062,"scheduling_latency_s":0.492076}1393gitlab # [ 151.862584] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"205858d0feabab0c3cd53f8c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-205858d0feabab0c3cd53f8c: done: 0.015206 sec","job_status":"done","queue_duration_s":0.492062,"scheduling_latency_s":0.492076,"redis_calls":16,"redis_duration_s":0.002308,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001442,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196394,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015206,"completed_at":"2026-10-04T11:35:09.864Z","load_balancing_strategy":"primary","db_duration_s":0.000243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 151.919677] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cba106f15e5a9b1d7dd89c5","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cba106f15e5a9b1d7dd89c5: start","job_status":"start","queue_duration_s":0.50841,"scheduling_latency_s":0.508424}1395gitlab # [ 151.920724] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cba106f15e5a9b1d7dd89c5","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cba106f15e5a9b1d7dd89c5: done: 0.010244 sec","job_status":"done","queue_duration_s":0.50841,"scheduling_latency_s":0.508424,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010244,"completed_at":"2026-10-04T11:35:09.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 151.946515] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ca667d3dfac7497c04b17f7","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ca667d3dfac7497c04b17f7: start","job_status":"start","queue_duration_s":0.519677,"scheduling_latency_s":0.519691}1397gitlab # [ 151.957910] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ca667d3dfac7497c04b17f7","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ca667d3dfac7497c04b17f7: done: 0.01025 sec","job_status":"done","queue_duration_s":0.519677,"scheduling_latency_s":0.519691,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01025,"completed_at":"2026-10-04T11:35:09.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 152.000387] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e43b02d3563f8f827609935c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e43b02d3563f8f827609935c: start","job_status":"start","queue_duration_s":0.530645,"scheduling_latency_s":0.530658}1399gitlab # [ 152.003866] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e43b02d3563f8f827609935c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e43b02d3563f8f827609935c: done: 0.010053 sec","job_status":"done","queue_duration_s":0.530645,"scheduling_latency_s":0.530658,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010053,"completed_at":"2026-10-04T11:35:09.898Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 152.063835] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b44a7a2c49175d05a742746f","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b44a7a2c49175d05a742746f: start","job_status":"start","queue_duration_s":0.541555,"scheduling_latency_s":0.541569}1401gitlab # [ 152.064981] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b44a7a2c49175d05a742746f","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b44a7a2c49175d05a742746f: done: 0.010104 sec","job_status":"done","queue_duration_s":0.541555,"scheduling_latency_s":0.541569,"redis_calls":13,"redis_duration_s":0.001733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010104,"completed_at":"2026-10-04T11:35:09.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 152.087547] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72f6046e946111d6b3d59d74","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72f6046e946111d6b3d59d74: start","job_status":"start","queue_duration_s":0.552577,"scheduling_latency_s":0.552589}1403gitlab # [ 152.099068] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72f6046e946111d6b3d59d74","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72f6046e946111d6b3d59d74: done: 0.010121 sec","job_status":"done","queue_duration_s":0.552577,"scheduling_latency_s":0.552589,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010121,"completed_at":"2026-10-04T11:35:09.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 152.138692] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e9fc699e988ae1d0f7474b5","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e9fc699e988ae1d0f7474b5: start","job_status":"start","queue_duration_s":0.563702,"scheduling_latency_s":0.563715}1405gitlab # [ 152.144924] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e9fc699e988ae1d0f7474b5","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e9fc699e988ae1d0f7474b5: done: 0.010638 sec","job_status":"done","queue_duration_s":0.563702,"scheduling_latency_s":0.563715,"redis_calls":13,"redis_duration_s":0.001551,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010638,"completed_at":"2026-10-04T11:35:09.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 152.199759] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f37ca67b6f46de5f8176ea74","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f37ca67b6f46de5f8176ea74: start","job_status":"start","queue_duration_s":0.575202,"scheduling_latency_s":0.575216}1407gitlab # [ 152.200897] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f37ca67b6f46de5f8176ea74","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f37ca67b6f46de5f8176ea74: done: 0.009999 sec","job_status":"done","queue_duration_s":0.575202,"scheduling_latency_s":0.575216,"redis_calls":13,"redis_duration_s":0.001718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009999,"completed_at":"2026-10-04T11:35:09.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 152.229204] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"101bfd95900b47511b3da83d","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-101bfd95900b47511b3da83d: start","job_status":"start","queue_duration_s":0.586271,"scheduling_latency_s":0.586285}1409gitlab # [ 152.272284] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"101bfd95900b47511b3da83d","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-101bfd95900b47511b3da83d: done: 0.010153 sec","job_status":"done","queue_duration_s":0.586271,"scheduling_latency_s":0.586285,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010153,"completed_at":"2026-10-04T11:35:09.953Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 152.274795] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae0f9aec4432b9b1f5b0ad10","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae0f9aec4432b9b1f5b0ad10: start","job_status":"start","queue_duration_s":0.597533,"scheduling_latency_s":0.597547}1411gitlab # [ 152.287196] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae0f9aec4432b9b1f5b0ad10","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae0f9aec4432b9b1f5b0ad10: done: 0.009926 sec","job_status":"done","queue_duration_s":0.597533,"scheduling_latency_s":0.597547,"redis_calls":13,"redis_duration_s":0.001584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009926,"completed_at":"2026-10-04T11:35:09.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 152.336176] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60138f23862166dadccb4224","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60138f23862166dadccb4224: start","job_status":"start","queue_duration_s":0.608478,"scheduling_latency_s":0.608491}1413gitlab # [ 152.337168] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60138f23862166dadccb4224","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60138f23862166dadccb4224: done: 0.00976 sec","job_status":"done","queue_duration_s":0.608478,"scheduling_latency_s":0.608491,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00976,"completed_at":"2026-10-04T11:35:09.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 152.371690] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32bba52cdff3d4534338f48f","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32bba52cdff3d4534338f48f: start","job_status":"start","queue_duration_s":0.619287,"scheduling_latency_s":0.6193}1415gitlab # [ 152.419125] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32bba52cdff3d4534338f48f","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32bba52cdff3d4534338f48f: done: 0.009864 sec","job_status":"done","queue_duration_s":0.619287,"scheduling_latency_s":0.6193,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009864,"completed_at":"2026-10-04T11:35:09.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 152.420091] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be38d9e42c30093b5e7c14c4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be38d9e42c30093b5e7c14c4: start","job_status":"start","queue_duration_s":0.630119,"scheduling_latency_s":0.630133}1417gitlab # [ 152.428968] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be38d9e42c30093b5e7c14c4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be38d9e42c30093b5e7c14c4: done: 0.010072 sec","job_status":"done","queue_duration_s":0.630119,"scheduling_latency_s":0.630133,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010072,"completed_at":"2026-10-04T11:35:09.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 152.469684] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:09.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f19b087c312829d54fd697c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f19b087c312829d54fd697c: start","job_status":"start","queue_duration_s":0.641051,"scheduling_latency_s":0.641064}1419gitlab # [ 152.475096] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f19b087c312829d54fd697c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f19b087c312829d54fd697c: done: 0.010116 sec","job_status":"done","queue_duration_s":0.641051,"scheduling_latency_s":0.641064,"redis_calls":13,"redis_duration_s":0.001646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010116,"completed_at":"2026-10-04T11:35:10.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 152.545064] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb85135c12673c082f1d65c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb85135c12673c082f1d65c: start","job_status":"start","queue_duration_s":0.652026,"scheduling_latency_s":0.65204}1421gitlab # [ 152.545943] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb85135c12673c082f1d65c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb85135c12673c082f1d65c: done: 0.009966 sec","job_status":"done","queue_duration_s":0.652026,"scheduling_latency_s":0.65204,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009966,"completed_at":"2026-10-04T11:35:10.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 152.558861] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"853e754b7d15d6b56692a327","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-853e754b7d15d6b56692a327: start","job_status":"start","queue_duration_s":0.662854,"scheduling_latency_s":0.662867}1423gitlab # [ 152.570661] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"853e754b7d15d6b56692a327","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-853e754b7d15d6b56692a327: done: 0.010051 sec","job_status":"done","queue_duration_s":0.662854,"scheduling_latency_s":0.662867,"redis_calls":13,"redis_duration_s":0.0017130000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010051,"completed_at":"2026-10-04T11:35:10.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 152.606713] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92a10cf4ba95049d620a9f37","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92a10cf4ba95049d620a9f37: start","job_status":"start","queue_duration_s":0.673761,"scheduling_latency_s":0.673775}1425gitlab # [ 152.649996] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92a10cf4ba95049d620a9f37","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92a10cf4ba95049d620a9f37: done: 0.010019 sec","job_status":"done","queue_duration_s":0.673761,"scheduling_latency_s":0.673775,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010019,"completed_at":"2026-10-04T11:35:10.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 152.651770] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899748883fa48dc451b8cc9a","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899748883fa48dc451b8cc9a: start","job_status":"start","queue_duration_s":0.684653,"scheduling_latency_s":0.684666}1427gitlab # [ 152.663071] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"899748883fa48dc451b8cc9a","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-899748883fa48dc451b8cc9a: done: 0.01001 sec","job_status":"done","queue_duration_s":0.684653,"scheduling_latency_s":0.684666,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01001,"completed_at":"2026-10-04T11:35:10.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 152.709393] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eadf92f99a779246350b699b","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eadf92f99a779246350b699b: start","job_status":"start","queue_duration_s":0.69567,"scheduling_latency_s":0.695684}1429gitlab # [ 152.710178] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eadf92f99a779246350b699b","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eadf92f99a779246350b699b: done: 0.0101 sec","job_status":"done","queue_duration_s":0.69567,"scheduling_latency_s":0.695684,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0101,"completed_at":"2026-10-04T11:35:10.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 152.744804] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f1921c74d71348fe0aa5232","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f1921c74d71348fe0aa5232: start","job_status":"start","queue_duration_s":0.706912,"scheduling_latency_s":0.706927}1431gitlab # [ 152.756150] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f1921c74d71348fe0aa5232","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f1921c74d71348fe0aa5232: done: 0.014469 sec","job_status":"done","queue_duration_s":0.706912,"scheduling_latency_s":0.706927,"redis_calls":13,"redis_duration_s":0.004919,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003538,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014469,"completed_at":"2026-10-04T11:35:10.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 152.797183] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f94087fa716468a3b94ac6c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f94087fa716468a3b94ac6c: start","job_status":"start","queue_duration_s":0.722269,"scheduling_latency_s":0.722283}1433gitlab # [ 152.801708] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f94087fa716468a3b94ac6c","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f94087fa716468a3b94ac6c: done: 0.010148 sec","job_status":"done","queue_duration_s":0.722269,"scheduling_latency_s":0.722283,"redis_calls":13,"redis_duration_s":0.0015789999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010148,"completed_at":"2026-10-04T11:35:10.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 152.845618] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbf53a2b26d001081c3f30e2","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbf53a2b26d001081c3f30e2: start","job_status":"start","queue_duration_s":0.733259,"scheduling_latency_s":0.733273}1435gitlab # [ 152.847173] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbf53a2b26d001081c3f30e2","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbf53a2b26d001081c3f30e2: done: 0.009841 sec","job_status":"done","queue_duration_s":0.733259,"scheduling_latency_s":0.733273,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009841,"completed_at":"2026-10-04T11:35:10.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 152.889130] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6128463dfc4e608e6a9af9f","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6128463dfc4e608e6a9af9f: start","job_status":"start","queue_duration_s":0.744307,"scheduling_latency_s":0.744319}1437gitlab # [ 152.894077] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6128463dfc4e608e6a9af9f","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6128463dfc4e608e6a9af9f: done: 0.009829 sec","job_status":"done","queue_duration_s":0.744307,"scheduling_latency_s":0.744319,"redis_calls":13,"redis_duration_s":0.0015699999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009829,"completed_at":"2026-10-04T11:35:10.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 152.960419] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dec7b7fee1eabe5d4a2ef55","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dec7b7fee1eabe5d4a2ef55: start","job_status":"start","queue_duration_s":0.755162,"scheduling_latency_s":0.755178}1439gitlab # [ 152.961196] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dec7b7fee1eabe5d4a2ef55","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dec7b7fee1eabe5d4a2ef55: done: 0.009959 sec","job_status":"done","queue_duration_s":0.755162,"scheduling_latency_s":0.755178,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009959,"completed_at":"2026-10-04T11:35:10.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 152.977090] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0f190175144bb9c07a7fe57","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0f190175144bb9c07a7fe57: start","job_status":"start","queue_duration_s":0.766107,"scheduling_latency_s":0.76612}1441gitlab # [ 152.988886] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0f190175144bb9c07a7fe57","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0f190175144bb9c07a7fe57: done: 0.010125 sec","job_status":"done","queue_duration_s":0.766107,"scheduling_latency_s":0.76612,"redis_calls":13,"redis_duration_s":0.0016679999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010125,"completed_at":"2026-10-04T11:35:10.133Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 153.038415] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4b177995ed2a2535cf312e8","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4b177995ed2a2535cf312e8: start","job_status":"start","queue_duration_s":0.777599,"scheduling_latency_s":0.777617}1443gitlab # [ 153.039231] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4b177995ed2a2535cf312e8","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4b177995ed2a2535cf312e8: done: 0.010009 sec","job_status":"done","queue_duration_s":0.777599,"scheduling_latency_s":0.777617,"redis_calls":13,"redis_duration_s":0.0016940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010009,"completed_at":"2026-10-04T11:35:10.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 153.071700] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c151a9f4266cf4cb80d7035","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c151a9f4266cf4cb80d7035: start","job_status":"start","queue_duration_s":0.788509,"scheduling_latency_s":0.788522}1445gitlab # [ 153.116406] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c151a9f4266cf4cb80d7035","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c151a9f4266cf4cb80d7035: done: 0.01004 sec","job_status":"done","queue_duration_s":0.788509,"scheduling_latency_s":0.788522,"redis_calls":13,"redis_duration_s":0.001806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01004,"completed_at":"2026-10-04T11:35:10.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 153.118033] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"484c1919b5332e0cfa09ea98","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-484c1919b5332e0cfa09ea98: start","job_status":"start","queue_duration_s":0.799396,"scheduling_latency_s":0.799411}1447gitlab # [ 153.160355] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"484c1919b5332e0cfa09ea98","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-484c1919b5332e0cfa09ea98: done: 0.01 sec","job_status":"done","queue_duration_s":0.799396,"scheduling_latency_s":0.799411,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01,"completed_at":"2026-10-04T11:35:10.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 153.203666] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8188ab874b5ba8e868ccdcf4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8188ab874b5ba8e868ccdcf4: start","job_status":"start","queue_duration_s":0.810318,"scheduling_latency_s":0.810331}1449gitlab # [ 153.204107] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8188ab874b5ba8e868ccdcf4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8188ab874b5ba8e868ccdcf4: done: 0.01007 sec","job_status":"done","queue_duration_s":0.810318,"scheduling_latency_s":0.810331,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01007,"completed_at":"2026-10-04T11:35:10.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 153.246110] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a3694327fe8ee17fcdb4f25","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a3694327fe8ee17fcdb4f25: start","job_status":"start","queue_duration_s":0.821231,"scheduling_latency_s":0.821269}1451gitlab # [ 153.247163] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a3694327fe8ee17fcdb4f25","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a3694327fe8ee17fcdb4f25: done: 0.010528 sec","job_status":"done","queue_duration_s":0.821231,"scheduling_latency_s":0.821269,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010528,"completed_at":"2026-10-04T11:35:10.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 153.259808] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ac5f15a8ea32e4f03d144a3","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ac5f15a8ea32e4f03d144a3: start","job_status":"start","queue_duration_s":0.832686,"scheduling_latency_s":0.8327}1453gitlab # [ 153.271313] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ac5f15a8ea32e4f03d144a3","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ac5f15a8ea32e4f03d144a3: done: 0.009964 sec","job_status":"done","queue_duration_s":0.832686,"scheduling_latency_s":0.8327,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009964,"completed_at":"2026-10-04T11:35:10.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 153.324636] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8c041f6a4be1ec115ff84c1","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8c041f6a4be1ec115ff84c1: start","job_status":"start","queue_duration_s":0.843505,"scheduling_latency_s":0.843518}1455gitlab # [ 153.325628] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8c041f6a4be1ec115ff84c1","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8c041f6a4be1ec115ff84c1: done: 0.01013 sec","job_status":"done","queue_duration_s":0.843505,"scheduling_latency_s":0.843518,"redis_calls":13,"redis_duration_s":0.001579,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01013,"completed_at":"2026-10-04T11:35:10.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 153.353975] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afa174ee5ed1e1ca659b0224","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afa174ee5ed1e1ca659b0224: start","job_status":"start","queue_duration_s":0.854511,"scheduling_latency_s":0.854523}1457gitlab # [ 153.364654] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afa174ee5ed1e1ca659b0224","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afa174ee5ed1e1ca659b0224: done: 0.009749 sec","job_status":"done","queue_duration_s":0.854511,"scheduling_latency_s":0.854523,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009749,"completed_at":"2026-10-04T11:35:10.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 153.405822] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c846328b02e48b43b8429453","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c846328b02e48b43b8429453: start","job_status":"start","queue_duration_s":0.865274,"scheduling_latency_s":0.865287}1459gitlab # [ 153.447137] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c846328b02e48b43b8429453","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c846328b02e48b43b8429453: done: 0.009891 sec","job_status":"done","queue_duration_s":0.865274,"scheduling_latency_s":0.865287,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009891,"completed_at":"2026-10-04T11:35:10.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 153.448189] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2377755d401e3cfeb072e0fe","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2377755d401e3cfeb072e0fe: start","job_status":"start","queue_duration_s":0.876156,"scheduling_latency_s":0.876171}1461gitlab # [ 153.492104] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2377755d401e3cfeb072e0fe","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2377755d401e3cfeb072e0fe: done: 0.009755 sec","job_status":"done","queue_duration_s":0.876156,"scheduling_latency_s":0.876171,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009755,"completed_at":"2026-10-04T11:35:10.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 153.493607] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2176c47a24232edf58119c05","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2176c47a24232edf58119c05: start","job_status":"start","queue_duration_s":0.88712,"scheduling_latency_s":0.887133}1463gitlab # [ 153.505300] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2176c47a24232edf58119c05","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2176c47a24232edf58119c05: done: 0.009926 sec","job_status":"done","queue_duration_s":0.88712,"scheduling_latency_s":0.887133,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009926,"completed_at":"2026-10-04T11:35:10.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 153.576943] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1404e0869a52a49c6b22f3e","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1404e0869a52a49c6b22f3e: start","job_status":"start","queue_duration_s":0.898319,"scheduling_latency_s":0.898333}1465gitlab # [ 153.577543] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1404e0869a52a49c6b22f3e","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1404e0869a52a49c6b22f3e: done: 0.009913 sec","job_status":"done","queue_duration_s":0.898319,"scheduling_latency_s":0.898333,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009913,"completed_at":"2026-10-04T11:35:10.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 153.590932] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"753dfdaf11b4a002efdc970a","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-753dfdaf11b4a002efdc970a: start","job_status":"start","queue_duration_s":0.909216,"scheduling_latency_s":0.909231}1467gitlab # [ 153.602652] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"753dfdaf11b4a002efdc970a","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-753dfdaf11b4a002efdc970a: done: 0.009876 sec","job_status":"done","queue_duration_s":0.909216,"scheduling_latency_s":0.909231,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009876,"completed_at":"2026-10-04T11:35:10.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 153.662280] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d7a78e52055a8bec853874b","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d7a78e52055a8bec853874b: start","job_status":"start","queue_duration_s":0.920026,"scheduling_latency_s":0.92004}1469gitlab # [ 153.662976] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d7a78e52055a8bec853874b","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d7a78e52055a8bec853874b: done: 0.010046 sec","job_status":"done","queue_duration_s":0.920026,"scheduling_latency_s":0.92004,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010046,"completed_at":"2026-10-04T11:35:10.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 153.706663] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8a84a5952b94069cea81daa","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8a84a5952b94069cea81daa: start","job_status":"start","queue_duration_s":0.930906,"scheduling_latency_s":0.93092}1471gitlab # [ 153.707590] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8a84a5952b94069cea81daa","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8a84a5952b94069cea81daa: done: 0.010011 sec","job_status":"done","queue_duration_s":0.930906,"scheduling_latency_s":0.93092,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010011,"completed_at":"2026-10-04T11:35:10.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 153.735163] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e972eab1e07d083044694891","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e972eab1e07d083044694891: start","job_status":"start","queue_duration_s":0.941845,"scheduling_latency_s":0.94186}1473gitlab # [ 153.746702] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e972eab1e07d083044694891","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e972eab1e07d083044694891: done: 0.009936 sec","job_status":"done","queue_duration_s":0.941845,"scheduling_latency_s":0.94186,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009936,"completed_at":"2026-10-04T11:35:10.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 153.784072] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"996e980ecb6f73dc8006da30","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-996e980ecb6f73dc8006da30: start","job_status":"start","queue_duration_s":0.952655,"scheduling_latency_s":0.952668}1475gitlab # [ 153.833900] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"996e980ecb6f73dc8006da30","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-996e980ecb6f73dc8006da30: done: 0.01013 sec","job_status":"done","queue_duration_s":0.952655,"scheduling_latency_s":0.952668,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01013,"completed_at":"2026-10-04T11:35:10.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 153.834924] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81cdc43ebd37af685ac3abf2","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81cdc43ebd37af685ac3abf2: start","job_status":"start","queue_duration_s":0.963652,"scheduling_latency_s":0.963666}1477gitlab # [ 153.843804] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81cdc43ebd37af685ac3abf2","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81cdc43ebd37af685ac3abf2: done: 0.010027 sec","job_status":"done","queue_duration_s":0.963652,"scheduling_latency_s":0.963666,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010027,"completed_at":"2026-10-04T11:35:10.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 153.881140] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6939a3897db42beed35e1cdb","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6939a3897db42beed35e1cdb: start","job_status":"start","queue_duration_s":0.974701,"scheduling_latency_s":0.974715}1479gitlab # [ 153.927118] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6939a3897db42beed35e1cdb","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6939a3897db42beed35e1cdb: done: 0.00993 sec","job_status":"done","queue_duration_s":0.974701,"scheduling_latency_s":0.974715,"redis_calls":13,"redis_duration_s":0.0015700000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00993,"completed_at":"2026-10-04T11:35:10.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 153.929212] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1a587bf2d6527038c9e3d4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1a587bf2d6527038c9e3d4: start","job_status":"start","queue_duration_s":0.985698,"scheduling_latency_s":0.985713}1481gitlab # [ 153.941577] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1a587bf2d6527038c9e3d4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1a587bf2d6527038c9e3d4: done: 0.009809 sec","job_status":"done","queue_duration_s":0.985698,"scheduling_latency_s":0.985713,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009809,"completed_at":"2026-10-04T11:35:10.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 154.004650] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f65918ed64c82c90c50f76f8","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f65918ed64c82c90c50f76f8: start","job_status":"start","queue_duration_s":0.996658,"scheduling_latency_s":0.996672}1483gitlab # [ 154.005487] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f65918ed64c82c90c50f76f8","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f65918ed64c82c90c50f76f8: done: 0.010078 sec","job_status":"done","queue_duration_s":0.996658,"scheduling_latency_s":0.996672,"redis_calls":13,"redis_duration_s":0.001607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010078,"completed_at":"2026-10-04T11:35:10.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 154.055830] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"437d8c1bbaf7b7a89d971296","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-437d8c1bbaf7b7a89d971296: start","job_status":"start","queue_duration_s":1.007776,"scheduling_latency_s":1.00779}1485gitlab # [ 154.056908] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"437d8c1bbaf7b7a89d971296","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-437d8c1bbaf7b7a89d971296: done: 0.009823 sec","job_status":"done","queue_duration_s":1.007776,"scheduling_latency_s":1.00779,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009823,"completed_at":"2026-10-04T11:35:10.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 154.071808] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20d2da1b69a719ff243caef4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20d2da1b69a719ff243caef4: start","job_status":"start","queue_duration_s":1.018632,"scheduling_latency_s":1.018647}1487gitlab # [ 154.082883] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20d2da1b69a719ff243caef4","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20d2da1b69a719ff243caef4: done: 0.009734 sec","job_status":"done","queue_duration_s":1.018632,"scheduling_latency_s":1.018647,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009734,"completed_at":"2026-10-04T11:35:10.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 154.136153] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6bbe13cb8ad87f137974344","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6bbe13cb8ad87f137974344: start","job_status":"start","queue_duration_s":1.029457,"scheduling_latency_s":1.029471}1489gitlab # [ 154.136977] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6bbe13cb8ad87f137974344","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6bbe13cb8ad87f137974344: done: 0.010188 sec","job_status":"done","queue_duration_s":1.029457,"scheduling_latency_s":1.029471,"redis_calls":13,"redis_duration_s":0.0016319999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010188,"completed_at":"2026-10-04T11:35:10.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 154.166154] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83db8ff3ed8532596edc617","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83db8ff3ed8532596edc617: start","job_status":"start","queue_duration_s":1.040545,"scheduling_latency_s":1.040559}1491gitlab # [ 154.177809] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83db8ff3ed8532596edc617","created_at":"2026-10-04T11:35:09.307Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-e076527532cb43bd","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eeea629e69f2aa9003704093b1d1cb61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.357Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83db8ff3ed8532596edc617: done: 0.009859 sec","job_status":"done","queue_duration_s":1.040545,"scheduling_latency_s":1.040559,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009859,"completed_at":"2026-10-04T11:35:10.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 154.215623] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"94bea615949a3125dc00ef25","created_at":"2026-10-04T11:35:09.010Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4da2ad8ac3223bccc081053b7714d8f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.747Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-94bea615949a3125dc00ef25: start","job_status":"start","queue_duration_s":0.661022,"scheduling_latency_s":0.661036}1493gitlab # [ 154.254056] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"94bea615949a3125dc00ef25","created_at":"2026-10-04T11:35:09.010Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4da2ad8ac3223bccc081053b7714d8f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.747Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-94bea615949a3125dc00ef25: done: 0.018378 sec","job_status":"done","queue_duration_s":0.661022,"scheduling_latency_s":0.661036,"redis_calls":10,"redis_duration_s":0.0015970000000000001,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230197,"duration_s":0.018378,"completed_at":"2026-10-04T11:35:10.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 154.264723] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"39b0412c8b01578783a77c65","created_at":"2026-10-04T11:35:09.757Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6298b4161eafc4c5c65bfffc17e6523","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.764Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-39b0412c8b01578783a77c65: start","job_status":"start","queue_duration_s":0.663378,"scheduling_latency_s":0.663393}1495gitlab # [ 154.278061] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"39b0412c8b01578783a77c65","created_at":"2026-10-04T11:35:09.757Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6298b4161eafc4c5c65bfffc17e6523","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.764Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-39b0412c8b01578783a77c65: done: 0.021577 sec","job_status":"done","queue_duration_s":0.663378,"scheduling_latency_s":0.663393,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006427633,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021577,"completed_at":"2026-10-04T11:35:10.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001646,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1496gitlab # [ 154.317890] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"522007b86e09f25e73267ea6","created_at":"2026-10-04T11:35:09.777Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d8f5585bb77c663ae0f05fa46a1607a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.783Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-522007b86e09f25e73267ea6: start","job_status":"start","queue_duration_s":0.667609,"scheduling_latency_s":0.667623}1497gitlab # [ 154.330091] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"522007b86e09f25e73267ea6","created_at":"2026-10-04T11:35:09.777Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d8f5585bb77c663ae0f05fa46a1607a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.783Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-522007b86e09f25e73267ea6: done: 0.020017 sec","job_status":"done","queue_duration_s":0.667609,"scheduling_latency_s":0.667623,"redis_calls":12,"redis_duration_s":0.003914,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000597,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000333003,"exclusive_lock_hold_duration_s":0.004869053999999999,"duration_s":0.020017,"completed_at":"2026-10-04T11:35:10.470Z","load_balancing_strategy":"primary","db_duration_s":0.001851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 154.367594] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.472Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"de77904c8e0e9702981e2920","created_at":"2026-10-04T11:35:09.787Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6561cad2aafa261dc17a8c2c56d2b740","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-04T11:35:09.792Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-de77904c8e0e9702981e2920: start","job_status":"start","queue_duration_s":0.679415,"scheduling_latency_s":0.679429}1499gitlab # [ 154.416226] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.479Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1500gitlab # [ 154.416945] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"de77904c8e0e9702981e2920","created_at":"2026-10-04T11:35:09.787Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6561cad2aafa261dc17a8c2c56d2b740","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-04T11:35:09.792Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-de77904c8e0e9702981e2920: done: 0.012611 sec","job_status":"done","queue_duration_s":0.679415,"scheduling_latency_s":0.679429,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195277,"duration_s":0.012611,"completed_at":"2026-10-04T11:35:10.484Z","load_balancing_strategy":"primary","db_duration_s":0.000253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 154.417938] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d56c27ad3c8ba7a364bcba4a","created_at":"2026-10-04T11:35:09.802Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"787c4dba2a789c13e861b2c75478fe4a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.807Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d56c27ad3c8ba7a364bcba4a: start","job_status":"start","queue_duration_s":0.678395,"scheduling_latency_s":0.678408}1502gitlab # [ 154.430514] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d56c27ad3c8ba7a364bcba4a","created_at":"2026-10-04T11:35:09.802Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"787c4dba2a789c13e861b2c75478fe4a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:09.807Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d56c27ad3c8ba7a364bcba4a: done: 0.023148 sec","job_status":"done","queue_duration_s":0.678395,"scheduling_latency_s":0.678408,"redis_calls":10,"redis_duration_s":0.001394,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238857,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.023148,"completed_at":"2026-10-04T11:35:10.508Z","load_balancing_strategy":"primary","db_duration_s":0.008009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 154.499975] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e0a236d0e18887f85575f3b7","created_at":"2026-10-04T11:35:09.811Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1120966a08bec841b9dfb70b0f9b0705","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-04T11:35:09.817Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e0a236d0e18887f85575f3b7: start","job_status":"start","queue_duration_s":0.692625,"scheduling_latency_s":0.692639}1504gitlab # [ 154.500770] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e0a236d0e18887f85575f3b7","created_at":"2026-10-04T11:35:09.811Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1120966a08bec841b9dfb70b0f9b0705","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-04T11:35:09.817Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e0a236d0e18887f85575f3b7: done: 0.021856 sec","job_status":"done","queue_duration_s":0.692625,"scheduling_latency_s":0.692639,"redis_calls":10,"redis_duration_s":0.001287,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200305,"duration_s":0.021856,"completed_at":"2026-10-04T11:35:10.531Z","load_balancing_strategy":"primary","db_duration_s":0.002235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 154.519379] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"31b6f60b4e836b3dd26832f2","created_at":"2026-10-04T11:35:09.825Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"feb892eb3f3190e6465a599cf5421b1a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:10.611Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-31b6f60b4e836b3dd26832f2: start","job_status":"start","queue_duration_s":0.002879,"scheduling_latency_s":0.00292}1506gitlab # [ 154.532080] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:10.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"31b6f60b4e836b3dd26832f2","created_at":"2026-10-04T11:35:09.825Z","trace_propagation_headers":{"sentry-trace":"f0370e61929e4ae0bf0e453e952195d3-69ea0f9047964ac6","baggage":"sentry-trace_id=f0370e61929e4ae0bf0e453e952195d3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"feb892eb3f3190e6465a599cf5421b1a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:10.611Z","job_size_bytes":2,"pid":1658,"sidekiq_tid":"maem","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-31b6f60b4e836b3dd26832f2: done: 0.023457 sec","job_status":"done","queue_duration_s":0.002879,"scheduling_latency_s":0.00292,"redis_calls":12,"redis_duration_s":0.001616,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000407593,"exclusive_lock_hold_duration_s":0.002913499,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023457,"completed_at":"2026-10-04T11:35:10.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 154.758424] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2342002855 wd_nsec: 23420029791508gitlab # [ 167.775835] setup-gitlab-start[2258]: W, [2026-10-04T11:35:25.814574 #2258] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1509gitlab # [ 191.573230] postgres[2466]: [2466] ERROR: relation "table_without_models" does not exist1510gitlab # [ 191.576389] postgres[2466]: [2466] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1511gitlab # [ 194.641914] runuser[2257]: pam_unix(runuser:session): session closed for user gitlab1512gitlab # [ 194.645539] setup-gitlab-start[2228]: + systemctl restart gitlab-sidekiq.service1513gitlab # [ 194.668149] systemd[1]: Stopping gitlab-sidekiq.service...1514gitlab # [ 194.671092] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:52.707Z","message":"Shutting down"}1515gitlab # [ 194.672639] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:52.707Z","message":"Scheduler exiting..."}1516gitlab # [ 194.674062] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:52.710Z","message":"Terminating quiet threads for default capsule"}1517gitlab # [ 194.675248] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:52.710Z","message":"Scheduler exiting..."}1518gitlab # [ 195.172146] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:53.211Z","message":"Pausing to allow jobs to finish..."}1519gitlab # [ 198.177341] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:56.215Z","message":"Bye!"}1520gitlab # [ 198.210145] sidekiq-cluster[1658]: {"severity":"INFO","time":"2026-10-04T11:35:56.249Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1658,"worker_id":"sidekiq_0","memwd_rss_bytes":976433152,"retry":0}1521gitlab # [ 199.500506] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1522gitlab # [ 199.503079] systemd[1]: Stopped gitlab-sidekiq.service.1523gitlab # [ 199.505387] systemd[1]: gitlab-sidekiq.service: Consumed 1min 1.376s CPU time over 2min 1.322s wall clock time, 967.6M memory peak, 4.4M read from disk.1524gitlab # [ 199.510393] systemd[1]: Started gitlab-sidekiq.service.1525gitlab # [ 199.512862] setup-gitlab-start[2228]: + mkdir -p /var/lib/secrets1526gitlab # [ 199.516799] setup-gitlab-start[2228]: + echo nixbot-test-token-of-20-chars1527gitlab # [ 199.518524] setup-gitlab-start[2228]: + chmod 644 /var/lib/secrets/gitlab-token1528gitlab # [ 199.521077] setup-gitlab-start[2228]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1529gitlab # [ 199.813177] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:35:57 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 2601530gitlab # [ 200.309770] gitaly[914]: time="2026-10-04T11:35:58.348Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.348" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 200.311095] gitaly[914]: time="2026-10-04T11:35:58.349Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.348" grpc.time_ms=0.348 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 200.450341] gitaly[914]: time="2026-10-04T11:35:58.489Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.489" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 200.453291] gitaly[914]: time="2026-10-04T11:35:58.492Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.489" grpc.time_ms=2.731 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 200.529831] gitaly[914]: time="2026-10-04T11:35:58.569Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT diskcache=e8067407-c640-42a9-8e7b-1eeef1719914 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T11:36:08.158" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.498" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 200.530808] gitaly[914]: time="2026-10-04T11:35:58.569Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1581 command.oublock=32 command.real_time_ms=41 command.spawn_token_fork_ms=19 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T11:36:08.158" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.498" grpc.time_ms=70.749 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 200.575956] gitaly[914]: time="2026-10-04T11:35:58.615Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.615" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1537gitlab # [ 200.577302] gitaly[914]: time="2026-10-04T11:35:58.615Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.615" grpc.time_ms=0.479 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 200.614444] gitaly[914]: time="2026-10-04T11:35:58.654Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:36:08.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.642" grpc.time_ms=10.972 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 200.681973] gitaly[914]: time="2026-10-04T11:35:58.721Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.080" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.721" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 200.705494] gitaly[914]: time="2026-10-04T11:35:58.722Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.080" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.721" grpc.time_ms=0.48 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 200.755728] gitaly[914]: time="2026-10-04T11:35:58.795Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT diskcache=c458c6c6-fb4d-4799-8b71-6ce0986ec512 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T11:36:08.083" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.723" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1542gitlab # [ 200.756636] gitaly[914]: time="2026-10-04T11:35:58.795Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1580 command.oublock=32 command.real_time_ms=41 command.spawn_token_fork_ms=17 command.system_time_ms=19 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T11:36:08.083" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.723" grpc.time_ms=71.782 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1543gitlab # [ 200.802540] gitaly[914]: time="2026-10-04T11:35:58.842Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.201" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.841" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1544gitlab # [ 200.803774] gitaly[914]: time="2026-10-04T11:35:58.842Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.201" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.841" grpc.time_ms=0.486 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 200.823382] gitaly[914]: time="2026-10-04T11:35:58.862Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:36:08.208" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.849" grpc.time_ms=13.315 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 200.854497] gitaly[914]: time="2026-10-04T11:35:58.894Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:36:08.253" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.893" grpc.time_ms=0.18 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 200.861197] gitaly[914]: time="2026-10-04T11:35:58.900Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T11:36:08.259" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:58.900" grpc.time_ms=0.382 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 201.410623] gitaly[914]: time="2026-10-04T11:35:59.449Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B615KDQQBD0FESAPZMAFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:36:09.098" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:35:59.439" grpc.time_ms=9.869 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1549gitlab # [ 201.671559] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:35:59 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 18341550gitlab # [ 201.678558] setup-gitlab-start[2525]: {"id":1,"message":null,"error":null}1551gitlab # [ 202.703232] sidekiq-cluster[2513]: {"severity":"INFO","time":"2026-10-04T11:36:00.724Z","message":"Starting cluster with 1 processes"}1552gitlab # [ 206.809362] gitaly[914]: time="2026-10-04T11:36:04.848Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B67WBWR73JBZEG57C47X5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:36:14.197" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:04.838" grpc.time_ms=10.098 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1553gitlab # [ 206.858916] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:04 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1501554gitlab # [ 206.862699] setup-gitlab-start[2228]: + mkdir -p /tmp/test-flake1555gitlab # [ 206.866411] setup-gitlab-start[2228]: + cd /tmp/test-flake1556gitlab # [ 206.866980] setup-gitlab-start[2228]: + git init -b master1557gitlab # [ 206.895626] setup-gitlab-start[2597]: Initialized empty Git repository in /tmp/test-flake/.git/1558gitlab # [ 206.896235] setup-gitlab-start[2228]: + git config user.name test1559gitlab # [ 206.900776] setup-gitlab-start[2228]: + git config user.email test@example.com1560gitlab # [ 206.905392] setup-gitlab-start[2228]: + cat1561gitlab # [ 206.909308] setup-gitlab-start[2228]: + git add flake.nix1562gitlab # [ 206.914813] setup-gitlab-start[2228]: + git commit -m 'initial commit'1563gitlab # [ 206.940152] setup-gitlab-start[2602]: [master (root-commit) bcf642e] initial commit1564gitlab # [ 206.942537] setup-gitlab-start[2602]: 1 file changed, 10 insertions(+)1565gitlab # [ 206.943714] setup-gitlab-start[2602]: create mode 100644 flake.nix1566gitlab # [ 206.944752] setup-gitlab-start[2228]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1567gitlab # [ 206.948521] setup-gitlab-start[2228]: + git push -u origin master1568gitlab # [ 207.128517] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:05 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1461569gitlab # [ 207.254808] gitaly[914]: time="2026-10-04T11:36:05.294Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B689HVT1V254HMX7ZC7HB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:05.286" grpc.time_ms=7.496 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1570gitlab # [ 207.257384] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:05 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1271571gitlab # [ 207.619543] gitaly[914]: time="2026-10-04T11:36:05.659Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:36:15.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:05.647" grpc.time_ms=11.305 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1572gitlab # [ 207.656072] gitaly[914]: time="2026-10-04T11:36:05.695Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-04T11:36:35.085" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-04T11:36:05.685" grpc.time_ms=9.354 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1573gitlab # [ 207.743332] gitaly[914]: time="2026-10-04T11:36:05.782Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M43B68DXQP1XJ9QXP688BH5H duration_ms=351ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1574gitlab # [ 207.791470] gitaly[914]: time="2026-10-04T11:36:05.831Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M43B68DXQP1XJ9QXP688BH5H duration_ms=47ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1575gitlab # [ 207.797432] gitaly[914]: time="2026-10-04T11:36:05.837Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:05.430" grpc.time_ms=406.278 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1576gitlab # [ 207.843093] gitaly[914]: time="2026-10-04T11:36:05.882Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:05.881" grpc.time_ms=0.857 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1577gitlab # [ 207.879689] gitaly[914]: time="2026-10-04T11:36:05.919Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:05.918" grpc.time_ms=0.511 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1578gitlab # [ 207.908694] gitaly[914]: time="2026-10-04T11:36:05.948Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:05.947" grpc.time_ms=0.643 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1579gitlab # [ 208.055266] gitaly[914]: time="2026-10-04T11:36:06.094Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:36:16.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:06.083" grpc.time_ms=11.257 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 208.122301] gitaly[914]: time="2026-10-04T11:36:06.161Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-04T11:36:16.056" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:06.136" grpc.time_ms=24.629 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 208.161462] gitaly[914]: time="2026-10-04T11:36:06.201Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M43B68DXQP1XJ9QXP688BH5H duration_ms=216ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1582gitlab # [ 208.167251] gitaly[914]: time="2026-10-04T11:36:06.206Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:05.984" grpc.time_ms=222.285 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1583gitlab # [ 208.202602] gitaly[914]: time="2026-10-04T11:36:06.241Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H diskcache=9443d1a2-1e2f-42e1-ad12-fba608ac3e99 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:05.368" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1584gitlab # [ 208.204866] gitaly[914]: time="2026-10-04T11:36:06.244Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=172 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13191 command.oublock=32 command.real_time_ms=858 command.spawn_token_fork_ms=1 command.system_time_ms=103 command.user_time_ms=69 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:05.368" grpc.time_ms=873.26 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1585gitlab # [ 208.206201] gitlab-workhorse[824]: time="2026-10-04T11:36:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521586gitlab # [ 208.206620] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:06 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9351587gitlab # [ 208.208632] setup-gitlab-start[2606]: To http://gitlab/root/test-flake.git1588gitlab # [ 208.209633] setup-gitlab-start[2606]: * [new branch] master -> master1589gitlab # [ 208.233266] setup-gitlab-start[2606]: branch 'master' set up to track 'origin/master'.1590gitlab # [ 208.237174] systemd[1]: Finished setup-gitlab.service.1591gitlab # [ 208.240027] systemd[1]: Starting nixbot CI service...1592gitlab: (finished: waiting for unit setup-gitlab.service, in 209.97 seconds)1593gitlab: waiting for unit nixbot.service1594gitlab # [ 209.599980] nixbot[2696]: {"ts": "2026-10-04T11:36:07.638Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1595gitlab # [ 209.650906] nixbot[2696]: {"ts": "2026-10-04T11:36:07.690Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1596gitlab # [ 209.677073] nixbot[2696]: {"ts": "2026-10-04T11:36:07.716Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1597gitlab # [ 209.682250] nixbot[2696]: {"ts": "2026-10-04T11:36:07.720Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1598gitlab # [ 209.687340] nixbot[2696]: {"ts": "2026-10-04T11:36:07.723Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1599gitlab # [ 209.692177] nixbot[2696]: {"ts": "2026-10-04T11:36:07.729Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1600gitlab # [ 209.697338] nixbot[2696]: {"ts": "2026-10-04T11:36:07.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1601gitlab # [ 209.702183] nixbot[2696]: {"ts": "2026-10-04T11:36:07.736Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1602gitlab # [ 209.706984] nixbot[2696]: {"ts": "2026-10-04T11:36:07.742Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1603gitlab # [ 209.711889] nixbot[2696]: {"ts": "2026-10-04T11:36:07.744Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1604gitlab # [ 209.716324] nixbot[2696]: {"ts": "2026-10-04T11:36:07.751Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1605gitlab # [ 209.722728] nixbot[2696]: {"ts": "2026-10-04T11:36:07.762Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1606gitlab # [ 209.727673] nixbot[2696]: {"ts": "2026-10-04T11:36:07.767Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1607gitlab # [ 209.735458] nixbot[2696]: {"ts": "2026-10-04T11:36:07.774Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1608gitlab # [ 209.745139] nixbot[2696]: {"ts": "2026-10-04T11:36:07.784Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1609gitlab # [ 209.752425] nixbot[2696]: {"ts": "2026-10-04T11:36:07.791Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1610gitlab # [ 209.759173] nixbot[2696]: {"ts": "2026-10-04T11:36:07.798Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1611gitlab # [ 209.763411] nixbot[2696]: {"ts": "2026-10-04T11:36:07.802Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1612gitlab # [ 209.770343] nixbot[2696]: {"ts": "2026-10-04T11:36:07.809Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1613gitlab # [ 209.774775] nixbot[2696]: {"ts": "2026-10-04T11:36:07.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1614gitlab # [ 209.779199] nixbot[2696]: {"ts": "2026-10-04T11:36:07.818Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1615gitlab # [ 209.785480] nixbot[2696]: {"ts": "2026-10-04T11:36:07.825Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1616gitlab # [ 209.789866] nixbot[2696]: {"ts": "2026-10-04T11:36:07.829Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1617gitlab # [ 209.794585] nixbot[2696]: {"ts": "2026-10-04T11:36:07.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1618gitlab # [ 209.799121] nixbot[2696]: {"ts": "2026-10-04T11:36:07.838Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1619gitlab # [ 209.804120] nixbot[2696]: {"ts": "2026-10-04T11:36:07.843Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1620gitlab # [ 209.810557] nixbot[2696]: {"ts": "2026-10-04T11:36:07.849Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1621gitlab # [ 209.815109] nixbot[2696]: {"ts": "2026-10-04T11:36:07.854Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1622gitlab # [ 209.819351] nixbot[2696]: {"ts": "2026-10-04T11:36:07.858Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1623gitlab # [ 209.838059] nixbot[2696]: {"ts": "2026-10-04T11:36:07.877Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1624gitlab # [ 209.845914] nixbot[2696]: {"ts": "2026-10-04T11:36:07.885Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1625gitlab # [ 209.850792] nixbot[2696]: {"ts": "2026-10-04T11:36:07.890Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1626gitlab # [ 209.855387] nixbot[2696]: {"ts": "2026-10-04T11:36:07.894Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1627gitlab # [ 209.861484] nixbot[2696]: {"ts": "2026-10-04T11:36:07.901Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1628gitlab # [ 209.865872] nixbot[2696]: {"ts": "2026-10-04T11:36:07.905Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1629gitlab # [ 209.873335] nixbot[2696]: {"ts": "2026-10-04T11:36:07.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1630gitlab # [ 209.878299] nixbot[2696]: {"ts": "2026-10-04T11:36:07.917Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1631gitlab # [ 209.884454] nixbot[2696]: {"ts": "2026-10-04T11:36:07.923Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_skip_key"}1632gitlab # [ 210.273744] nixbot[2696]: INFO: Started server process [2696]1633gitlab # [ 210.275478] nixbot[2696]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1634gitlab # [ 210.292701] nixbot[2696]: INFO: ::ffff:127.0.0.1:38622 - "GET /health HTTP/1.1" 200 OK1635gitlab # [ 210.300291] systemd[1]: Started nixbot CI service.1636gitlab # [ 210.302107] systemd[1]: Reached target Multi-User System.1637gitlab # [ 210.304081] systemd[1]: Startup finished in 1.200s (kernel) + 3.681s (initrd) + 3min 25.422s (userspace) = 3min 30.303s.1638gitlab: (finished: waiting for unit nixbot.service, in 1.06 seconds)1639gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1640gitlab # [ 210.415516] nixbot[2696]: INFO: ::ffff:127.0.0.1:38634 - "GET /health HTTP/1.1" 200 OK1641gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1642subtest: project discovered and webhook registered1643gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1644gitlab # [ 210.509499] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 541645gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1646gitlab # [ 211.081309] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7891647gitlab # [ 211.087541] nixbot[2696]: {"ts": "2026-10-04T11:36:09.123Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1648gitlab # [ 211.104106] nixbot[2696]: {"ts": "2026-10-04T11:36:09.143Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1649gitlab # [ 211.175909] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 621650gitlab # [ 211.181073] nixbot[2696]: {"ts": "2026-10-04T11:36:09.216Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1651gitlab # [ 211.186421] nixbot[2696]: {"ts": "2026-10-04T11:36:09.218Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1652gitlab # [ 211.290545] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1081653gitlab # [ 211.295651] nixbot[2696]: {"ts": "2026-10-04T11:36:09.331Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1654gitlab # [ 211.409771] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1121655gitlab # [ 211.415439] nixbot[2696]: {"ts": "2026-10-04T11:36:09.449Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1656gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1657gitlab # [ 211.514817] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 921658gitlab # [ 211.516449] nixbot[2696]: {"ts": "2026-10-04T11:36:09.555Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1659gitlab # [ 211.589471] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 421660gitlab # [ 211.595498] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 731661gitlab # [ 211.601215] nixbot[2696]: {"ts": "2026-10-04T11:36:09.640Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1662gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1663(finished: subtest: project discovered and webhook registered, in 1.18 seconds)1664subtest: push delivers the webhook1665gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1666gitlab # [ 211.667832] gitaly[914]: time="2026-10-04T11:36:09.707Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6CNSE47D5JG988GPZ9ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-04T11:36:39.095" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:09.695" grpc.time_ms=10.836 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1667gitlab # [ 211.701974] gitaly[914]: time="2026-10-04T11:36:09.741Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6CNSE47D5JG988GPZ9ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:36:39.140" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:09.740" grpc.time_ms=0.566 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 211.722472] gitaly[914]: time="2026-10-04T11:36:09.762Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6CNSE47D5JG988GPZ9ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-04T11:36:19.115" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:09.755" grpc.time_ms=6.129 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 211.745699] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1271670gitlab # [ 211.748889] nixbot[2696]: {"ts": "2026-10-04T11:36:09.788Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1671gitlab # [ 211.825582] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 701672gitlab # [ 211.831496] nixbot[2696]: {"ts": "2026-10-04T11:36:09.865Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1673gitlab # [ 211.837729] nixbot[2696]: {"ts": "2026-10-04T11:36:09.869Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1674gitlab # [ 211.991882] gitaly[914]: time="2026-10-04T11:36:10.031Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B6CZ9BT1YVKMMNC9GVKRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.018" grpc.time_ms=12.936 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1675gitlab # [ 212.021480] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 991676gitlab # [ 212.144320] gitaly[914]: time="2026-10-04T11:36:10.183Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6D2JB0K6CKE93KZ0EKH1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.169" pid=914 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1677gitlab # [ 212.170711] gitaly[914]: time="2026-10-04T11:36:10.184Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6D2JB0K6CKE93KZ0EKH1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.169" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1678gitlab # [ 212.192450] gitlab-workhorse[824]: time="2026-10-04T11:36:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131679gitlab # [ 212.194308] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1191680gitlab # [ 212.196235] gitaly[914]: time="2026-10-04T11:36:10.184Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6D2JB0K6CKE93KZ0EKH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.169" grpc.time_ms=14.477 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1681gitlab # [ 212.235667] gitaly[914]: time="2026-10-04T11:36:10.275Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6D730271V453QET1P36Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.254" pid=914 remote_ip="2001:db8:1::1" request_sha=e36af006fd1605b2670791e47756775fa8c6003e response_bytes=223 span.kind=server system=grpc1682gitlab # [ 212.236920] gitaly[914]: time="2026-10-04T11:36:10.275Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6D730271V453QET1P36Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.254" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1683gitlab # [ 212.258471] gitaly[914]: time="2026-10-04T11:36:10.297Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6D730271V453QET1P36Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.254" grpc.time_ms=20.793 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1684gitlab # [ 212.259678] gitlab-workhorse[824]: time="2026-10-04T11:36:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231685gitlab # [ 212.260530] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 861686gitlab # [ 212.374164] gitaly[914]: time="2026-10-04T11:36:10.413Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M43B6DBPWC6PQ7PBYGD0ZTJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.400" grpc.time_ms=12.255 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 212.376270] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551688gitlab # [ 212.455756] gitaly[914]: time="2026-10-04T11:36:10.495Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DDJG3JSJVHT3SRPZAPZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.482" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1689gitlab # [ 212.458096] gitaly[914]: time="2026-10-04T11:36:10.495Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DDJG3JSJVHT3SRPZAPZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.482" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1690gitlab # [ 212.499059] gitaly[914]: time="2026-10-04T11:36:10.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DDJG3JSJVHT3SRPZAPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.482" grpc.time_ms=55.686 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1691gitlab # [ 212.512821] gitlab-workhorse[824]: time="2026-10-04T11:36:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671692gitlab # [ 212.513855] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1331693gitlab # [ 212.604122] gitaly[914]: time="2026-10-04T11:36:10.635Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B6DJVBTK23VM6QVR3HYD5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.625" grpc.time_ms=9.251 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 212.605625] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511695gitlab # [ 212.694858] gitaly[914]: time="2026-10-04T11:36:10.734Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DMJ183CE8ZH736N4JEA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.723" pid=914 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1696gitlab # [ 212.695695] gitaly[914]: time="2026-10-04T11:36:10.734Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DMJ183CE8ZH736N4JEA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.723" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1697gitlab # [ 212.696440] gitaly[914]: time="2026-10-04T11:36:10.734Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DMJ183CE8ZH736N4JEA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:10.723" grpc.time_ms=11.32 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 212.729436] gitlab-workhorse[824]: time="2026-10-04T11:36:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091699gitlab # [ 212.730222] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1261700gitlab # [ 212.908210] gitaly[914]: time="2026-10-04T11:36:10.947Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:36:40.345" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:10.946" grpc.time_ms=0.876 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 212.974479] gitaly[914]: time="2026-10-04T11:36:11.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-04T11:36:41.005" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:11.005" grpc.time_ms=7.577 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 213.005416] gitaly[914]: time="2026-10-04T11:36:11.045Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:36:21.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:11.035" grpc.time_ms=9.605 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 213.047856] gitaly[914]: time="2026-10-04T11:36:11.087Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:36:21.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:11.078" grpc.time_ms=8.891 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 213.139280] gitaly[914]: time="2026-10-04T11:36:11.178Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T11:36:21.147" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:11.178" grpc.time_ms=0.515 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 213.184397] gitaly[914]: time="2026-10-04T11:36:11.223Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T11:36:21.181" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:11.211" grpc.time_ms=11.842 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 213.271389] gitaly[914]: time="2026-10-04T11:36:11.310Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:11.310" grpc.time_ms=0.655 pid=914 span.kind=server system=grpc1707gitlab # [ 213.331915] gitaly[914]: time="2026-10-04T11:36:11.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:11.371" grpc.time_ms=0.399 pid=914 span.kind=server system=grpc1708gitlab # [ 213.363683] gitaly[914]: time="2026-10-04T11:36:11.403Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 diskcache=fe1f55f0-94e8-4440-b7d8-19c05013979d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T11:36:21.225" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:11.256" pid=914 ref=refs/keep-around/bcf642e8a4691223eedc542a96536b9bb612f2f8 remote_ip="2001:db8:1::1" revision=bcf642e8a4691223eedc542a96536b9bb612f2f8 span.kind=server system=grpc username=root1709gitlab # [ 213.375646] gitaly[914]: time="2026-10-04T11:36:11.415Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=133 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5286 command.oublock=8 command.real_time_ms=136 command.spawn_token_fork_ms=0 command.system_time_ms=83 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T11:36:21.225" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:11.256" grpc.time_ms=147.177 pid=914 ref=refs/keep-around/bcf642e8a4691223eedc542a96536b9bb612f2f8 remote_ip="2001:db8:1::1" revision=bcf642e8a4691223eedc542a96536b9bb612f2f8 span.kind=server system=grpc username=root1710gitlab # [ 213.376942] gitaly[914]: time="2026-10-04T11:36:11.416Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:36:41.414" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:11.415" grpc.time_ms=1.366 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 213.522881] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 7521712gitlab # [ 213.524877] nixbot[2696]: {"ts": "2026-10-04T11:36:11.563Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1713gitlab # [ 213.536418] nixbot[2696]: {"ts": "2026-10-04T11:36:11.575Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-bcf642e8a469-0"}1714gitlab # [ 213.725807] nixbot[2696]: {"ts": "2026-10-04T11:36:11.765Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-bcf642e8a469-0", "argv0": "bwrap"}1715gitlab # [ 213.851114] systemd[1]: Started Nix Daemon.1716gitlab # [ 213.915454] nix-daemon[2863]: accepted connection from pid 2858, user nixbot1717gitlab # [ 218.367457] nix-daemon[2863]: accepted connection from pid 2905, user nixbot1718gitlab # [ 218.382476] nix-daemon[2863]: accepted connection from pid 2858, user nixbot1719gitlab # [ 222.569689] nix-daemon[2863]: accepted connection from pid 2858, user nixbot1720gitlab # [ 222.658649] nix-daemon[2863]: accepted connection from pid 2947, user nixbot1721gitlab # [ 222.705829] gitaly[914]: time="2026-10-04T11:36:20.744Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6QE66ECXW4ZQZVBV94QH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:36:50.143" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:20.743" grpc.time_ms=0.859 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 222.803989] gitaly[914]: time="2026-10-04T11:36:20.843Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B6QE66ECXW4ZQZVBV94QH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:36:30.192" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:20.833" grpc.time_ms=10.105 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 222.913544] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2721724gitlab # [ 222.920725] nixbot[2696]: {"ts": "2026-10-04T11:36:20.953Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1725gitlab # [ 222.979303] gitaly[914]: time="2026-10-04T11:36:21.018Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6QPXMR48PHHS162KZ0HY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:36:51.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:21.017" grpc.time_ms=0.915 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 223.122807] gitaly[914]: time="2026-10-04T11:36:21.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B6QPXMR48PHHS162KZ0HY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:36:31.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:21.151" grpc.time_ms=10.981 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727gitlab # [ 223.166336] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2471728gitlab # [ 223.173329] nixbot[2696]: {"ts": "2026-10-04T11:36:21.212Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1729gitlab # [ 227.726402] nix-daemon[2863]: accepted connection from pid 3016, user nixbot1730gitlab # [ 227.813946] gitaly[914]: time="2026-10-04T11:36:25.852Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6WE1KD9TZ9SBFF3TT554 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:36:55.250" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:25.851" grpc.time_ms=0.91 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 227.850157] gitaly[914]: time="2026-10-04T11:36:25.889Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B6WE1KD9TZ9SBFF3TT554 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:36:35.242" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:25.882" grpc.time_ms=6.729 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 227.888203] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1331733gitlab # [ 227.891488] nixbot[2696]: {"ts": "2026-10-04T11:36:25.930Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1734gitlab # [ 228.203665] gitaly[914]: time="2026-10-04T11:36:26.243Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M43B6WT2W3ASHEBECTRAS5ER grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.230" grpc.time_ms=12.368 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1735gitlab # [ 228.205719] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651736gitlab # [ 228.302199] gitaly[914]: time="2026-10-04T11:36:26.341Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6WX6HGC454SEJRDM2SAB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.330" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1737gitlab # [ 228.304414] gitaly[914]: time="2026-10-04T11:36:26.341Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6WX6HGC454SEJRDM2SAB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.330" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1738gitlab # [ 228.345678] gitaly[914]: time="2026-10-04T11:36:26.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6WX6HGC454SEJRDM2SAB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.330" grpc.time_ms=11.183 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1739gitlab # [ 228.347832] gitlab-workhorse[824]: time="2026-10-04T11:36:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671740gitlab # [ 228.348814] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1071741gitlab # [ 228.443558] gitaly[914]: time="2026-10-04T11:36:26.483Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B6X1Y8E5VAKTFJ5DY496A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.474" grpc.time_ms=8.739 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 228.445642] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 541743gitlab # [ 228.536078] gitaly[914]: time="2026-10-04T11:36:26.575Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6X4E78WWXK5DMBFMHS7Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.564" pid=914 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1744gitlab # [ 228.537333] gitaly[914]: time="2026-10-04T11:36:26.575Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6X4E78WWXK5DMBFMHS7Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.564" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 228.578177] gitaly[914]: time="2026-10-04T11:36:26.617Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6X4E78WWXK5DMBFMHS7Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:26.564" grpc.time_ms=53.262 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1746gitlab # [ 228.591530] gitlab-workhorse[824]: time="2026-10-04T11:36:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671747gitlab # [ 228.592536] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1201748gitlab # [ 229.822597] sidekiq-cluster[2570]: 2026-10-04T11:36:27.861Z pid=2570 tid=xb6 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2570, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434966528}1749gitlab # [ 230.001925] sidekiq-cluster[2570]: W, [2026-10-04T11:36:28.041413 #2570] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1750gitlab # [ 230.041716] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:28.081Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1751gitlab # [ 231.944421] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:29.982Z","message":"GitLab reliable fetch activated!"}1752gitlab # [ 231.945294] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:29.983Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1753gitlab # [ 254.043628] postgres[3279]: [3279] ERROR: relation "table_without_models" does not exist1754gitlab # [ 254.045452] postgres[3279]: [3279] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1755gitlab # [ 256.632443] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:54.671Z","message":"Booted Rails 7.2.3.1 application in production environment"}1756gitlab # [ 256.636503] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:54.674Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1757gitlab # [ 256.641322] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:54.674Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1758gitlab # [ 256.645372] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:54.674Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1759gitlab # [ 256.649967] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:54.676Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1760gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 45.72 seconds)1761gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1762gitlab # [ 257.422332] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 421763gitlab # [ 257.499508] gitaly[914]: time="2026-10-04T11:36:55.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SDB2GXHWXKZY3JV3D0Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:55.529" grpc.time_ms=9.254 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab # [ 257.528820] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 711765gitlab # Enumerating objects: 5, done.1766gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1767gitlab # Delta compression using up to 4 threads1768gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1769gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done.1770gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1771gitlab # [ 257.754334] gitaly[914]: time="2026-10-04T11:36:55.793Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-04T11:37:25.181" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-04T11:36:55.782" grpc.time_ms=11.314 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 257.786566] gitaly[914]: time="2026-10-04T11:36:55.810Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 duration_ms=87ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1773gitlab # [ 257.791892] gitaly[914]: time="2026-10-04T11:36:55.830Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 duration_ms=19ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1774gitlab # [ 257.797209] gitaly[914]: time="2026-10-04T11:36:55.831Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:55.722" grpc.time_ms=108.967 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1775gitlab # [ 257.850206] gitaly[914]: time="2026-10-04T11:36:55.889Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:55.888" grpc.time_ms=0.75 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1776gitlab # [ 257.896534] gitaly[914]: time="2026-10-04T11:36:55.936Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:55.935" grpc.time_ms=0.666 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1777gitlab # [ 257.927305] gitaly[914]: time="2026-10-04T11:36:55.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:55.966" grpc.time_ms=0.458 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1778gitlab # [ 257.996939] gitaly[914]: time="2026-10-04T11:36:56.036Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 duration_ms=42ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1779gitlab # [ 257.997821] gitaly[914]: time="2026-10-04T11:36:56.037Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:55.993" grpc.time_ms=43.539 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1780gitlab # [ 258.036774] gitaly[914]: time="2026-10-04T11:36:56.076Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 diskcache=652d4513-099c-4395-9901-db7239c8635e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:55.652" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 258.037795] gitaly[914]: time="2026-10-04T11:36:56.076Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=174 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=880640 command.minflt=13689 command.oublock=32 command.real_time_ms=413 command.spawn_token_fork_ms=0 command.system_time_ms=108 command.user_time_ms=66 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:36:55.652" grpc.time_ms=423.964 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1782gitlab # [ 258.038912] gitlab-workhorse[824]: time="2026-10-04T11:36:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521783gitlab # [ 258.040064] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:36:56 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4811784gitlab # To http://gitlab/root/test-flake.git1785gitlab # bcf642e..d491feb master -> master1786gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.75 seconds)1787gitlab: must succeed: git -C /tmp/test-flake rev-parse master1788gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1789gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1790gitlab # [ 258.140125] nixbot[2696]: INFO: ::ffff:127.0.0.1:47420 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK1791gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.06 seconds)1792gitlab # [ 258.398679] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.437Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e040df79128b6831b91356d5","created_at":"2026-10-04T11:35:58.668Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:58.702Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e040df79128b6831b91356d5: start","job_status":"start","queue_duration_s":57.73547,"scheduling_latency_s":57.735516}1793gitlab # [ 258.575894] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.615Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e040df79128b6831b91356d5","created_at":"2026-10-04T11:35:58.668Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:58.702Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e040df79128b6831b91356d5: done: 0.177599 sec","job_status":"done","queue_duration_s":57.73547,"scheduling_latency_s":57.735516,"redis_calls":24,"redis_duration_s":0.005575999999999999,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.00296,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.081512595,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.177599,"completed_at":"2026-10-04T11:36:56.615Z","load_balancing_strategy":"primary","db_duration_s":0.059422,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1794gitlab # [ 258.577648] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.616Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b860a9dcc03aa3ebd5229fab","created_at":"2026-10-04T11:35:58.711Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:58.716Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b860a9dcc03aa3ebd5229fab: start","job_status":"start","queue_duration_s":57.899782,"scheduling_latency_s":57.899799}1795gitlab # [ 258.736874] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.775Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b860a9dcc03aa3ebd5229fab","created_at":"2026-10-04T11:35:58.711Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:58.716Z","job_size_bytes":2,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b860a9dcc03aa3ebd5229fab: done: 0.159323 sec","job_status":"done","queue_duration_s":57.899782,"scheduling_latency_s":57.899799,"redis_calls":14,"redis_duration_s":0.00409,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000707,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001959,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.135460792,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.159323,"completed_at":"2026-10-04T11:36:56.775Z","load_balancing_strategy":"primary","db_duration_s":0.090223,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1796gitlab # [ 258.738914] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.778Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"44fe0a9b5ee2a5fd71e5b891","created_at":"2026-10-04T11:35:59.326Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:59.332Z","job_size_bytes":5,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-44fe0a9b5ee2a5fd71e5b891: start","job_status":"start","queue_duration_s":57.446025,"scheduling_latency_s":57.44606}1797gitlab # [ 258.877965] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.917Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"44fe0a9b5ee2a5fd71e5b891","created_at":"2026-10-04T11:35:59.326Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:59.332Z","job_size_bytes":5,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-44fe0a9b5ee2a5fd71e5b891: done: 0.139065 sec","job_status":"done","queue_duration_s":57.446025,"scheduling_latency_s":57.44606,"redis_calls":12,"redis_duration_s":0.0033569999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000931,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000359264,"duration_s":0.139065,"completed_at":"2026-10-04T11:36:56.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027454,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1798gitlab # [ 258.880101] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:56.918Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c8686428f96b069a7dcae5b1","created_at":"2026-10-04T11:35:59.355Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:59.358Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c8686428f96b069a7dcae5b1: start","job_status":"start","queue_duration_s":57.560088,"scheduling_latency_s":57.560104}1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1800gitlab # [ 259.092673] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:57.131Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c8686428f96b069a7dcae5b1","created_at":"2026-10-04T11:35:59.355Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:59.358Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c8686428f96b069a7dcae5b1: done: 0.213311 sec","job_status":"done","queue_duration_s":57.560088,"scheduling_latency_s":57.560104,"redis_calls":11,"redis_duration_s":0.002608,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001538,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.132,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.132,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000309257,"duration_s":0.213311,"completed_at":"2026-10-04T11:36:57.131Z","load_balancing_strategy":"primary","db_duration_s":0.179658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1801gitlab # [ 259.095786] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:57.133Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"81c361220c56595168f715d6","created_at":"2026-10-04T11:35:59.361Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:59.365Z","job_size_bytes":89,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-81c361220c56595168f715d6: start","job_status":"start","queue_duration_s":57.768387,"scheduling_latency_s":57.768403}1802gitlab # [ 259.127493] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:57.161Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"81c361220c56595168f715d6","created_at":"2026-10-04T11:35:59.361Z","trace_propagation_headers":{"sentry-trace":"9c931d9dfb964ff1bb2334e5ad37acb0-0513d63cf6e64e6c","baggage":"sentry-trace_id=9c931d9dfb964ff1bb2334e5ad37acb0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B615KDQQBD0FESAPZMAFT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-04T11:35:59.365Z","job_size_bytes":89,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-81c361220c56595168f715d6: done: 0.028488 sec","job_status":"done","queue_duration_s":57.768387,"scheduling_latency_s":57.768403,"redis_calls":11,"redis_duration_s":0.0028669999999999998,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000764,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000315962,"duration_s":0.028488,"completed_at":"2026-10-04T11:36:57.161Z","load_balancing_strategy":"primary","db_duration_s":0.005812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1803gitlab # [ 259.188595] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:57.163Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 bcf642e8a4691223eedc542a96536b9bb612f2f8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c1b1480055496a6cf9d01229","created_at":"2026-10-04T11:36:06.021Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-c8ffd601dacd4965","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:36:06.047Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c1b1480055496a6cf9d01229: start","job_status":"start","queue_duration_s":51.115542,"scheduling_latency_s":51.115556}1804gitlab # [ 259.199045] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:57.174Z","message":"changes: \"0000000000000000000000000000000000000000 bcf642e8a4691223eedc542a96536b9bb612f2f8 refs/heads/master\\n\""}1805gitlab # [ 259.201608] gitaly[914]: time="2026-10-04T11:36:57.215Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:07.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:57.206" grpc.time_ms=8.919 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 259.243951] gitaly[914]: time="2026-10-04T11:36:57.224Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:37:07.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:57.219" grpc.time_ms=4.814 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 259.272046] gitaly[914]: time="2026-10-04T11:36:57.311Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=35 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-04T11:37:07.071" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:57.271" grpc.time_ms=40.078 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 259.290618] nixbot[2696]: INFO: ::ffff:127.0.0.1:47424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.15 seconds)1810gitlab # [ 259.308847] gitaly[914]: time="2026-10-04T11:36:57.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:57.347" grpc.time_ms=0.574 pid=914 span.kind=server system=grpc1811gitlab # [ 259.339353] gitaly[914]: time="2026-10-04T11:36:57.378Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:57.378" grpc.time_ms=0.3 pid=914 span.kind=server system=grpc1812gitlab # [ 259.359365] gitaly[914]: time="2026-10-04T11:36:57.398Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H diskcache=06a83b99-3b66-4748-bae0-edcfa6200ca1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T11:37:07.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:57.324" pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1813gitlab # [ 259.360233] gitaly[914]: time="2026-10-04T11:36:57.399Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=46 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5119 command.oublock=8 command.real_time_ms=65 command.spawn_token_fork_ms=0 command.system_time_ms=24 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T11:37:07.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:57.324" grpc.time_ms=74.785 pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1814gitlab # [ 259.394781] gitaly[914]: time="2026-10-04T11:36:57.434Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T11:37:07.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:57.434" grpc.time_ms=0.216 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 259.421209] gitaly[914]: time="2026-10-04T11:36:57.460Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-04T11:37:07.247" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:57.448" grpc.time_ms=12.269 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 259.498153] gitaly[914]: time="2026-10-04T11:36:57.537Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-04T11:37:27.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:57.530" grpc.time_ms=7.311 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 259.551545] gitaly[914]: time="2026-10-04T11:36:57.591Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T11:37:07.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:57.590" grpc.time_ms=0.21 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 259.582549] gitaly[914]: time="2026-10-04T11:36:57.622Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-04T11:37:07.033" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-04T11:36:57.614" grpc.time_ms=7.665 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 259.636210] gitaly[914]: time="2026-10-04T11:36:57.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:07.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:57.662" grpc.time_ms=12.68 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 259.679674] gitaly[914]: time="2026-10-04T11:36:57.719Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:07.127" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:57.707" grpc.time_ms=11.131 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 259.715835] gitaly[914]: time="2026-10-04T11:36:57.755Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-04T11:37:27.236" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:57.736" grpc.time_ms=18.581 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 260.082961] gitaly[914]: time="2026-10-04T11:36:58.122Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-04T11:37:08.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:58.120" grpc.time_ms=1.635 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 260.124557] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.163Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 bcf642e8a4691223eedc542a96536b9bb612f2f8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c1b1480055496a6cf9d01229","created_at":"2026-10-04T11:36:06.021Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-c8ffd601dacd4965","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:36:06.047Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c1b1480055496a6cf9d01229: done: 0.999873 sec","job_status":"done","queue_duration_s":51.115542,"scheduling_latency_s":51.115556,"gitaly_calls":13,"gitaly_duration_s":0.339351,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.045096000000000004,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.004615,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.0065,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001357,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004601,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.016039,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011984,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.198,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.22,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.546111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001103492,"exclusive_lock_hold_duration_s":0.030306086000000003,"duration_s":0.999873,"completed_at":"2026-10-04T11:36:58.162Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.11893,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1824gitlab # [ 260.171196] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.164Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ece8002b045a27216efbbc09","created_at":"2026-10-04T11:36:11.419Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.426Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ece8002b045a27216efbbc09: start","job_status":"start","queue_duration_s":46.737691,"scheduling_latency_s":46.737707}1825gitlab # [ 260.216769] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.256Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ece8002b045a27216efbbc09","created_at":"2026-10-04T11:36:11.419Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.426Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ece8002b045a27216efbbc09: done: 0.091604 sec","job_status":"done","queue_duration_s":46.737691,"scheduling_latency_s":46.737707,"redis_calls":16,"redis_duration_s":0.00409,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002213,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000306743,"duration_s":0.091604,"completed_at":"2026-10-04T11:36:58.255Z","load_balancing_strategy":"primary","db_duration_s":0.047521,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1826gitlab # [ 260.218617] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.257Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c9c26856a47994298b5ffd11","created_at":"2026-10-04T11:36:11.427Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.430Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c9c26856a47994298b5ffd11: start","job_status":"start","queue_duration_s":46.827076,"scheduling_latency_s":46.827093}1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1828gitlab # [ 260.299676] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.338Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c9c26856a47994298b5ffd11","created_at":"2026-10-04T11:36:11.427Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.430Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c9c26856a47994298b5ffd11: done: 0.081265 sec","job_status":"done","queue_duration_s":46.827076,"scheduling_latency_s":46.827093,"redis_calls":21,"redis_duration_s":0.005188,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00226,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001451,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328254,"duration_s":0.081265,"completed_at":"2026-10-04T11:36:58.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1829gitlab # [ 260.301915] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2dca0540a52223b038c7a2bc","created_at":"2026-10-04T11:36:11.544Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.548Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2dca0540a52223b038c7a2bc: start","job_status":"start","queue_duration_s":46.791395,"scheduling_latency_s":46.79141}1830gitlab # [ 260.376922] nixbot[2696]: INFO: ::ffff:127.0.0.1:47426 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.09 seconds)1832gitlab # [ 260.441889] gitaly[914]: time="2026-10-04T11:36:58.481Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:58.480" grpc.time_ms=0.673 pid=914 span.kind=server system=grpc1833gitlab # [ 260.482971] gitaly[914]: time="2026-10-04T11:36:58.522Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:58.521" grpc.time_ms=0.692 pid=914 span.kind=server system=grpc1834gitlab # [ 260.523692] gitaly[914]: time="2026-10-04T11:36:58.563Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:36:58.562" grpc.time_ms=0.35 pid=914 span.kind=server system=grpc1835gitlab # [ 260.544204] gitaly[914]: time="2026-10-04T11:36:58.583Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 diskcache=fb0074b7-04cf-46a2-b514-cf53e35bce57 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:28.050" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:58.451" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 260.545371] gitaly[914]: time="2026-10-04T11:36:58.584Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=122 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7639 command.oublock=0 command.real_time_ms=123 command.spawn_token_fork_ms=0 command.system_time_ms=76 command.user_time_ms=46 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:28.050" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:58.451" grpc.time_ms=132.737 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 260.754216] gitaly[914]: time="2026-10-04T11:36:58.793Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:28.291" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:58.792" grpc.time_ms=1.15 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1838gitlab # [ 260.785697] gitaly[914]: time="2026-10-04T11:36:58.825Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B6DSS2ZH861ZZX3MSHA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:28.323" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:58.824" grpc.time_ms=0.952 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 260.804084] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2dca0540a52223b038c7a2bc","created_at":"2026-10-04T11:36:11.544Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.548Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2570,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2dca0540a52223b038c7a2bc: rescheduled"}1840gitlab # [ 260.817296] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.856Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"2dca0540a52223b038c7a2bc","created_at":"2026-10-04T11:36:11.544Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-8cd297c0e0634e16","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:11.548Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2dca0540a52223b038c7a2bc: done: 0.515957 sec","job_status":"done","queue_duration_s":46.791395,"scheduling_latency_s":46.79141,"gitaly_calls":3,"gitaly_duration_s":0.144872,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.113015,"redis_read_bytes":460,"redis_write_bytes":29296,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001224,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00144,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.01205,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.085534,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15584,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007394,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000588,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000815,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002746,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.025,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.029,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.27361,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.459346369,"duration_s":0.515957,"completed_at":"2026-10-04T11:36:58.856Z","load_balancing_strategy":"primary","db_duration_s":0.073732,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1841gitlab # [ 260.864408] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.858Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","bcf642e8a4691223eedc542a96536b9bb612f2f8 d491feb0b1425b7570c0949701f208f527bdd677 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c8f5489617ab3a656a7564a8","created_at":"2026-10-04T11:36:56.019Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-ff58161b4ec44b1b","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:36:56.021Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c8f5489617ab3a656a7564a8: start","job_status":"start","queue_duration_s":2.837575,"scheduling_latency_s":2.837608}1842gitlab # [ 260.865174] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.872Z","message":"changes: \"bcf642e8a4691223eedc542a96536b9bb612f2f8 d491feb0b1425b7570c0949701f208f527bdd677 refs/heads/master\\n\""}1843gitlab # [ 260.865669] gitaly[914]: time="2026-10-04T11:36:58.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:08.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:58.893" grpc.time_ms=6.799 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 260.871096] gitaly[914]: time="2026-10-04T11:36:58.909Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T11:37:08.013" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:58.904" grpc.time_ms=5.278 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 260.919066] gitaly[914]: time="2026-10-04T11:36:58.941Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-04T11:37:08.043" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:58.933" grpc.time_ms=8.012 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 260.919784] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:58.917Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"196c0ab78eeec9bb513b168d","created_at":"2026-10-04T11:36:58.914Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"d9cebc9f1067bf589b6ddb2d","job_size_bytes":46,"pid":2570,"job_status":"deduplicated","message":"ProjectCacheWorker JID-196c0ab78eeec9bb513b168d: deduplicated: until executing","deduplication.type":"until executing"}1847gitlab # [ 260.920627] gitaly[914]: time="2026-10-04T11:36:58.952Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=658 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-04T11:37:28.445" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:58.946" grpc.time_ms=6.237 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab # [ 260.963865] gitaly[914]: time="2026-10-04T11:36:58.966Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-04T11:37:08.071" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-04T11:36:58.961" grpc.time_ms=4.232 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 260.964880] gitaly[914]: time="2026-10-04T11:36:58.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:08.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:58.971" grpc.time_ms=5.026 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 260.998867] gitaly[914]: time="2026-10-04T11:36:59.038Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-04T11:37:09.007" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.037" grpc.time_ms=0.915 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1851gitlab # [ 261.037106] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.075Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","bcf642e8a4691223eedc542a96536b9bb612f2f8 d491feb0b1425b7570c0949701f208f527bdd677 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c8f5489617ab3a656a7564a8","created_at":"2026-10-04T11:36:56.019Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-ff58161b4ec44b1b","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T11:36:56.021Z","job_size_bytes":185,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c8f5489617ab3a656a7564a8: done: 0.217378 sec","job_status":"done","queue_duration_s":2.837575,"scheduling_latency_s":2.837608,"gitaly_calls":7,"gitaly_duration_s":0.064204,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.020827,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.002036,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000974,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003044,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007469,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007304,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000722717,"exclusive_lock_hold_duration_s":0.017076472,"duration_s":0.217378,"completed_at":"2026-10-04T11:36:59.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023828,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1852gitlab # [ 261.042061] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.078Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d9cebc9f1067bf589b6ddb2d","created_at":"2026-10-04T11:36:57.227Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:57.255Z","job_size_bytes":46,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d9cebc9f1067bf589b6ddb2d: start","job_status":"start","queue_duration_s":1.822928,"scheduling_latency_s":1.822966}1853gitlab # [ 261.088756] gitaly[914]: time="2026-10-04T11:36:59.128Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-04T17:36:59.122" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:36:59.123" grpc.time_ms=4.925 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 261.107132] gitaly[914]: time="2026-10-04T11:36:59.146Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-04T11:37:29.034" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.135" grpc.time_ms=11.3 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 261.132123] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.170Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d9cebc9f1067bf589b6ddb2d","created_at":"2026-10-04T11:36:57.227Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:57.255Z","job_size_bytes":46,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d9cebc9f1067bf589b6ddb2d: done: 0.092733 sec","job_status":"done","queue_duration_s":1.822928,"scheduling_latency_s":1.822966,"gitaly_calls":2,"gitaly_duration_s":0.021339,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007468,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001473,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000567,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001614,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002978,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000273778,"duration_s":0.092733,"completed_at":"2026-10-04T11:36:59.170Z","load_balancing_strategy":"primary","db_duration_s":0.013615,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1856gitlab # [ 261.136247] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.172Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"140b34154e42734ef513b0ce","created_at":"2026-10-04T11:36:57.265Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:57.268Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-140b34154e42734ef513b0ce: start","job_status":"start","queue_duration_s":1.903732,"scheduling_latency_s":1.903748}1857gitlab # [ 261.179516] gitaly[914]: time="2026-10-04T11:36:59.219Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H diskcache=5cf139bb-1953-4437-9692-712b44caf940 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T17:36:59.189" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.190" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 261.180427] gitaly[914]: time="2026-10-04T11:36:59.219Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1287 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T17:36:59.189" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.190" grpc.time_ms=29.09 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 261.209744] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.249Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"140b34154e42734ef513b0ce","created_at":"2026-10-04T11:36:57.265Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:57.268Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-140b34154e42734ef513b0ce: done: 0.077036 sec","job_status":"done","queue_duration_s":1.903732,"scheduling_latency_s":1.903748,"gitaly_calls":1,"gitaly_duration_s":0.031448,"redis_calls":15,"redis_duration_s":0.003365,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000605,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060081938,"duration_s":0.077036,"completed_at":"2026-10-04T11:36:59.249Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1860gitlab # [ 261.219869] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.250Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"e9d083df5fa168693a4494c5","created_at":"2026-10-04T11:36:57.429Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:57.431Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e9d083df5fa168693a4494c5: start","job_status":"start","queue_duration_s":1.819038,"scheduling_latency_s":1.819054}1861gitlab # [ 261.240480] gitaly[914]: time="2026-10-04T11:36:59.280Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-04T11:37:29.170" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.270" grpc.time_ms=9.19 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 261.256079] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.294Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"e9d083df5fa168693a4494c5","created_at":"2026-10-04T11:36:57.429Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:57.431Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e9d083df5fa168693a4494c5: done: 0.044006 sec","job_status":"done","queue_duration_s":1.819038,"scheduling_latency_s":1.819054,"gitaly_calls":1,"gitaly_duration_s":0.011453,"redis_calls":16,"redis_duration_s":0.003745,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000416,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001563,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044006,"completed_at":"2026-10-04T11:36:59.294Z","load_balancing_strategy":"primary","db_duration_s":0.002603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1863gitlab # [ 261.297909] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:36:59.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7d7f13e594be8311caa030ee","created_at":"2026-10-04T11:36:57.999Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf78af6925537e72c6cd3d48159be934d4aa16c1f5473b6b9a249dd6319aec72","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.002Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7d7f13e594be8311caa030ee: start","job_status":"start","queue_duration_s":1.294267,"scheduling_latency_s":1.294302}1864gitlab # [ 261.341894] gitaly[914]: time="2026-10-04T11:36:59.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:29.223" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.324" grpc.time_ms=0.497 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 261.342850] gitaly[914]: time="2026-10-04T11:36:59.332Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T11:37:09.296" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:59.326" grpc.time_ms=5.581 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 261.368158] gitaly[914]: time="2026-10-04T11:36:59.407Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:29.306" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.406" grpc.time_ms=0.844 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1868gitlab # [ 261.373195] gitaly[914]: time="2026-10-04T11:36:59.412Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=68 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-04T11:37:29.309" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.410" grpc.time_ms=2.451 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 261.413718] nixbot[2696]: INFO: ::ffff:127.0.0.1:47438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.03 seconds)1871gitlab # [ 261.463161] gitaly[914]: time="2026-10-04T11:36:59.502Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:09.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:36:59.491" grpc.time_ms=10.57 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 261.921792] gitaly[914]: time="2026-10-04T11:36:59.961Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-04T11:37:29.840" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.941" grpc.time_ms=19.762 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 261.942637] gitaly[914]: time="2026-10-04T11:36:59.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B68DXQP1XJ9QXP688BH5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-04T11:37:29.865" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:36:59.965" grpc.time_ms=16.154 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 261.987530] sidekiq-cluster[2570]: {"severity":"WARN","time":"2026-10-04T11:37:00.027Z","class":"CreatePipelineWorker","correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"bcf642e8a4691223eedc542a96536b9bb612f2f8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"bcf642e8a4691223eedc542a96536b9bb612f2f8","ref":"refs/heads/master"},"retry":0}1875gitlab # [ 262.003589] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7d7f13e594be8311caa030ee","created_at":"2026-10-04T11:36:57.999Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cf78af6925537e72c6cd3d48159be934d4aa16c1f5473b6b9a249dd6319aec72","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.002Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7d7f13e594be8311caa030ee: done: 0.745798 sec","job_status":"done","queue_duration_s":1.294267,"scheduling_latency_s":1.294302,"gitaly_calls":7,"gitaly_duration_s":0.091388,"redis_calls":51,"redis_duration_s":0.040296,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000825,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004276,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002548,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.021232,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.563017,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229358,"duration_s":0.745798,"completed_at":"2026-10-04T11:37:00.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04987,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1876gitlab # [ 262.008849] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.044Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"0e031d3b-d03a-4bb6-b3f9-205bd3943830\"}"],"class":"WebHookWorker","jid":"7a4d075d25d4d801f65bd0ec","created_at":"2026-10-04T11:36:58.095Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:13f32f6aca2053197e3186ac873da2f00356ae0511be50536cde86238536e14f","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.101Z","job_size_bytes":1751,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7a4d075d25d4d801f65bd0ec: start","job_status":"start","queue_duration_s":1.943528,"scheduling_latency_s":1.943544}1877gitlab # [ 262.130994] nixbot[2696]: INFO: ::ffff:127.0.0.1:47440 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1878gitlab # [ 262.147949] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.186Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"0e031d3b-d03a-4bb6-b3f9-205bd3943830\"}"],"class":"WebHookWorker","jid":"7a4d075d25d4d801f65bd0ec","created_at":"2026-10-04T11:36:58.095Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-6ede485f95fc4fef","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:13f32f6aca2053197e3186ac873da2f00356ae0511be50536cde86238536e14f","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.101Z","job_size_bytes":1751,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7a4d075d25d4d801f65bd0ec: done: 0.142067 sec","job_status":"done","queue_duration_s":1.943528,"scheduling_latency_s":1.943544,"redis_calls":19,"redis_duration_s":0.005104,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.001108,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002032,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05995957599998292,"cpu_s":0.068678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000421841,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.142067,"completed_at":"2026-10-04T11:37:00.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1879gitlab # [ 262.212165] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bdc02c0a63659cdf5be888b9","created_at":"2026-10-04T11:36:58.438Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.442Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bdc02c0a63659cdf5be888b9: start","job_status":"start","queue_duration_s":1.807767,"scheduling_latency_s":1.807803}1880gitlab # [ 262.271120] gitaly[914]: time="2026-10-04T11:37:00.310Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7Y1BS466F9B7Q9WTNM0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.301" grpc.time_ms=9.417 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1881gitlab # [ 262.285419] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1121882gitlab # [ 262.286676] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.320Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bdc02c0a63659cdf5be888b9","created_at":"2026-10-04T11:36:58.438Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.442Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bdc02c0a63659cdf5be888b9: done: 0.070799 sec","job_status":"done","queue_duration_s":1.807767,"scheduling_latency_s":1.807803,"redis_calls":10,"redis_duration_s":0.002582,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000966883,"duration_s":0.070799,"completed_at":"2026-10-04T11:37:00.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1883gitlab # [ 262.288815] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.322Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"48857ff68c0755d136587f85","created_at":"2026-10-04T11:36:58.591Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.598Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-48857ff68c0755d136587f85: start","job_status":"start","queue_duration_s":1.723862,"scheduling_latency_s":1.723877}1884gitlab # [ 262.368607] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.407Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"48857ff68c0755d136587f85","created_at":"2026-10-04T11:36:58.591Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.598Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-48857ff68c0755d136587f85: done: 0.085476 sec","job_status":"done","queue_duration_s":1.723862,"scheduling_latency_s":1.723877,"redis_calls":10,"redis_duration_s":0.05962,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.058338,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238578,"duration_s":0.085476,"completed_at":"2026-10-04T11:37:00.407Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1885gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1886gitlab # [ 262.391062] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.409Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"44f92271d01e356e2a6e1f5f","created_at":"2026-10-04T11:36:58.613Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.620Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-44f92271d01e356e2a6e1f5f: start","job_status":"start","queue_duration_s":1.788396,"scheduling_latency_s":1.788411}1887gitlab # [ 262.410628] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"44f92271d01e356e2a6e1f5f","created_at":"2026-10-04T11:36:58.613Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.620Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-44f92271d01e356e2a6e1f5f: done: 0.040657 sec","job_status":"done","queue_duration_s":1.788396,"scheduling_latency_s":1.788411,"redis_calls":10,"redis_duration_s":0.003443,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000525486,"duration_s":0.040657,"completed_at":"2026-10-04T11:37:00.449Z","load_balancing_strategy":"primary","db_duration_s":0.006948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1888gitlab # [ 262.424313] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"858891d657f8fdbd5f7034d6","created_at":"2026-10-04T11:36:58.636Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.645Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-858891d657f8fdbd5f7034d6: start","job_status":"start","queue_duration_s":1.80589,"scheduling_latency_s":1.805906}1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.07 seconds)1890gitlab # [ 262.443046] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"858891d657f8fdbd5f7034d6","created_at":"2026-10-04T11:36:58.636Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.645Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-858891d657f8fdbd5f7034d6: done: 0.031247 sec","job_status":"done","queue_duration_s":1.80589,"scheduling_latency_s":1.805906,"redis_calls":13,"redis_duration_s":0.003148,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000738,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001213,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257295,"duration_s":0.031247,"completed_at":"2026-10-04T11:37:00.482Z","load_balancing_strategy":"primary","db_duration_s":0.007689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1891gitlab # [ 262.516337] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.483Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3ced2738fadbc0a4cc3ef58d","created_at":"2026-10-04T11:36:58.646Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.652Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3ced2738fadbc0a4cc3ef58d: start","job_status":"start","queue_duration_s":1.830993,"scheduling_latency_s":1.831007}1892gitlab # [ 262.516923] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.505Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3ced2738fadbc0a4cc3ef58d","created_at":"2026-10-04T11:36:58.646Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.652Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3ced2738fadbc0a4cc3ef58d: done: 0.022173 sec","job_status":"done","queue_duration_s":1.830993,"scheduling_latency_s":1.831007,"redis_calls":10,"redis_duration_s":0.002249,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000754,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200026,"duration_s":0.022173,"completed_at":"2026-10-04T11:37:00.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1893gitlab # [ 262.559692] nixbot[2696]: INFO: ::ffff:127.0.0.1:47454 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK1894gitlab # [ 262.560575] gitlab-workhorse[824]: time="2026-10-04T11:37:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671895gitlab # [ 262.561157] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2451896gitlab # [ 262.561845] gitaly[914]: time="2026-10-04T11:37:00.562Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7Y4XXT1BJXDBZ9M7NEY1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.554" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1897gitlab # [ 262.562678] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.506Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b7a5724f1cf5a089ad8c59eb","created_at":"2026-10-04T11:36:58.653Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.660Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b7a5724f1cf5a089ad8c59eb: start","job_status":"start","queue_duration_s":1.846478,"scheduling_latency_s":1.846493}1898gitlab # [ 262.567205] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.528Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b7a5724f1cf5a089ad8c59eb","created_at":"2026-10-04T11:36:58.653Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.660Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b7a5724f1cf5a089ad8c59eb: done: 0.021926 sec","job_status":"done","queue_duration_s":1.846478,"scheduling_latency_s":1.846493,"redis_calls":11,"redis_duration_s":0.00191,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001108,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000546159,"duration_s":0.021926,"completed_at":"2026-10-04T11:37:00.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 262.609092] gitaly[914]: time="2026-10-04T11:37:00.562Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7Y4XXT1BJXDBZ9M7NEY1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.554" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1900gitlab # [ 262.621061] gitlab-workhorse[824]: time="2026-10-04T11:37:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421901gitlab # [ 262.622700] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.55.0" 701902gitlab # [ 262.663849] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.530Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"52a5084c6eb57beb59bf272c","created_at":"2026-10-04T11:36:58.664Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.669Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-52a5084c6eb57beb59bf272c: start","job_status":"start","queue_duration_s":1.86068,"scheduling_latency_s":1.860696}1903gitlab # [ 262.664721] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.564Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"52a5084c6eb57beb59bf272c","created_at":"2026-10-04T11:36:58.664Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.669Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-52a5084c6eb57beb59bf272c: done: 0.034439 sec","job_status":"done","queue_duration_s":1.86068,"scheduling_latency_s":1.860696,"redis_calls":10,"redis_duration_s":0.002383,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000373,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005104,"duration_s":0.034439,"completed_at":"2026-10-04T11:37:00.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1904gitlab # [ 262.717772] gitaly[914]: time="2026-10-04T11:37:00.562Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7Y4XXT1BJXDBZ9M7NEY1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.554" grpc.time_ms=8.573 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 262.718133] nixbot[2696]: {"ts": "2026-10-04T11:37:00.717Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1906gitlab # [ 262.718662] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f82d9963623f8887ae2798c1","created_at":"2026-10-04T11:36:58.670Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.675Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f82d9963623f8887ae2798c1: start","job_status":"start","queue_duration_s":1.891047,"scheduling_latency_s":1.891072}1907gitlab # [ 262.719962] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f82d9963623f8887ae2798c1","created_at":"2026-10-04T11:36:58.670Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.675Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f82d9963623f8887ae2798c1: done: 0.031398 sec","job_status":"done","queue_duration_s":1.891047,"scheduling_latency_s":1.891072,"redis_calls":10,"redis_duration_s":0.001742,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000365,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024193,"duration_s":0.031398,"completed_at":"2026-10-04T11:37:00.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1908gitlab # [ 262.770214] gitaly[914]: time="2026-10-04T11:37:00.634Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YCMFHYQ6AGVMGYHSBA1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.620" pid=914 remote_ip="2001:db8:1::1" request_sha=008f721f50d1b0235b92d8646a21010b06259b0e response_bytes=342 span.kind=server system=grpc1909gitlab # [ 262.770965] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.604Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a940d5e7691d659ebab6b1fc","created_at":"2026-10-04T11:36:58.763Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.766Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a940d5e7691d659ebab6b1fc: start","job_status":"start","queue_duration_s":1.837554,"scheduling_latency_s":1.837581}1910gitlab # [ 262.779108] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.636Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a940d5e7691d659ebab6b1fc","created_at":"2026-10-04T11:36:58.763Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.766Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a940d5e7691d659ebab6b1fc: done: 0.031575 sec","job_status":"done","queue_duration_s":1.837554,"scheduling_latency_s":1.837581,"redis_calls":10,"redis_duration_s":0.0016690000000000001,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328813,"duration_s":0.031575,"completed_at":"2026-10-04T11:37:00.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1911gitlab # [ 262.819751] gitaly[914]: time="2026-10-04T11:37:00.634Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YCMFHYQ6AGVMGYHSBA1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.620" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 262.832689] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.637Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"95921234102466afaf47e3ab","created_at":"2026-10-04T11:36:58.767Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.770Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-95921234102466afaf47e3ab: start","job_status":"start","queue_duration_s":1.867337,"scheduling_latency_s":1.867358}1913gitlab # [ 262.871129] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.658Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"95921234102466afaf47e3ab","created_at":"2026-10-04T11:36:58.767Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.770Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-95921234102466afaf47e3ab: done: 0.021182 sec","job_status":"done","queue_duration_s":1.867337,"scheduling_latency_s":1.867358,"redis_calls":10,"redis_duration_s":0.003711,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00277,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001092597,"duration_s":0.021182,"completed_at":"2026-10-04T11:37:00.658Z","load_balancing_strategy":"primary","db_duration_s":0.003016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1914gitlab # [ 262.885321] gitaly[914]: time="2026-10-04T11:37:00.635Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YCMFHYQ6AGVMGYHSBA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:00.620" grpc.time_ms=14.569 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915gitlab # [ 262.925175] nixbot[2696]: {"ts": "2026-10-04T11:37:00.881Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1916gitlab # [ 262.925865] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5ddc47265d5961f8a8eeb977","created_at":"2026-10-04T11:36:58.770Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.773Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5ddc47265d5961f8a8eeb977: start","job_status":"start","queue_duration_s":1.88728,"scheduling_latency_s":1.887296}1917gitlab # [ 262.926526] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5ddc47265d5961f8a8eeb977","created_at":"2026-10-04T11:36:58.770Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.773Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5ddc47265d5961f8a8eeb977: done: 0.023609 sec","job_status":"done","queue_duration_s":1.88728,"scheduling_latency_s":1.887296,"redis_calls":10,"redis_duration_s":0.00146,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224609,"duration_s":0.023609,"completed_at":"2026-10-04T11:37:00.684Z","load_balancing_strategy":"primary","db_duration_s":0.004315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1918gitlab # [ 262.954899] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1511919gitlab # [ 262.956746] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1081920gitlab # [ 262.996346] gitaly[914]: time="2026-10-04T11:37:00.786Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:30.184" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:00.785" grpc.time_ms=0.542 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 262.997066] gitaly[914]: time="2026-10-04T11:37:00.802Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 diskcache=1e07b51f-9f77-4025-9bbf-ea88e6669f04 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T17:37:00.791" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:00.791" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 262.997666] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.685Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"e1111fa6a34b5d7c4e7015c1","created_at":"2026-10-04T11:36:58.778Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.781Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-e1111fa6a34b5d7c4e7015c1: start","job_status":"start","queue_duration_s":1.903952,"scheduling_latency_s":1.903966}1923gitlab # [ 262.998454] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.743Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"e1111fa6a34b5d7c4e7015c1","created_at":"2026-10-04T11:36:58.778Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.781Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-e1111fa6a34b5d7c4e7015c1: done: 0.057441 sec","job_status":"done","queue_duration_s":1.903952,"scheduling_latency_s":1.903966,"redis_calls":14,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058946,"duration_s":0.057441,"completed_at":"2026-10-04T11:37:00.743Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 263.054103] nixbot[2696]: {"ts": "2026-10-04T11:37:00.993Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1925gitlab # [ 263.054717] nixbot[2696]: {"ts": "2026-10-04T11:37:01.087Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 \"HTTP/1.1 201 Created\""}1926gitlab # [ 263.055252] gitaly[914]: time="2026-10-04T11:37:00.802Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T17:37:00.791" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:00.791" grpc.time_ms=10.377 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 263.055973] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.744Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"aaa03a0c50f2b62a7900efba","created_at":"2026-10-04T11:36:58.844Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.846Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-aaa03a0c50f2b62a7900efba: start","job_status":"start","queue_duration_s":1.8979,"scheduling_latency_s":1.897916}1928gitlab # [ 263.094685] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.768Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"aaa03a0c50f2b62a7900efba","created_at":"2026-10-04T11:36:58.844Z","trace_propagation_headers":{"sentry-trace":"168e7bebca304df498fdfad548bd4f17-2af3594502974ec8","baggage":"sentry-trace_id=168e7bebca304df498fdfad548bd4f17,sentry-release=Unknown"},"correlation_id":"01M43B6DSS2ZH861ZZX3MSHA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.846Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-aaa03a0c50f2b62a7900efba: done: 0.024297 sec","job_status":"done","queue_duration_s":1.8979,"scheduling_latency_s":1.897916,"redis_calls":8,"redis_duration_s":0.001507,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024297,"completed_at":"2026-10-04T11:37:00.768Z","load_balancing_strategy":"primary","db_duration_s":0.005406,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1929gitlab # [ 263.101720] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bcf642e8a4691223eedc542a96536b9bb612f2f8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 881930gitlab # [ 263.104027] gitaly[914]: time="2026-10-04T11:37:00.837Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:30.736" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:00.837" grpc.time_ms=0.386 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 263.116269] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.772Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b8a46afa5d11eb03e89e7cd6","created_at":"2026-10-04T11:36:58.925Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"140b34154e42734ef513b0ce","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.928Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b8a46afa5d11eb03e89e7cd6: start","job_status":"start","queue_duration_s":1.844284,"scheduling_latency_s":1.844312}1932gitlab # [ 263.166559] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.817Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b8a46afa5d11eb03e89e7cd6","created_at":"2026-10-04T11:36:58.925Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"140b34154e42734ef513b0ce","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:58.928Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b8a46afa5d11eb03e89e7cd6: done: 0.044954 sec","job_status":"done","queue_duration_s":1.844284,"scheduling_latency_s":1.844312,"gitaly_calls":1,"gitaly_duration_s":0.012535,"redis_calls":12,"redis_duration_s":0.00367,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0007,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.028547204,"duration_s":0.044954,"completed_at":"2026-10-04T11:37:00.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1933gitlab # [ 263.173268] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391934gitlab # [ 263.174957] gitlab-workhorse[824]: time="2026-10-04T11:37:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671935gitlab # [ 263.176796] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 441936gitlab # [ 263.178618] gitaly[914]: time="2026-10-04T11:37:00.840Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:10.193" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:00.833" grpc.time_ms=6.3 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 263.190671] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:00.819Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a2416e502fe60a5ec8a8beb1","created_at":"2026-10-04T11:36:59.014Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8643c3164c45025dcecc5fd4891bd5081a04848ca8b195bae74b67d9859b81c9","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:59.016Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a2416e502fe60a5ec8a8beb1: start","job_status":"start","queue_duration_s":1.802942,"scheduling_latency_s":1.802957}1938gitlab # [ 263.235733] gitaly[914]: time="2026-10-04T11:37:00.929Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YPMZG3VAY1W5HV3S8F7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:30.327" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:00.928" grpc.time_ms=0.532 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 263.236578] gitaly[914]: time="2026-10-04T11:37:00.958Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7YPMZG3VAY1W5HV3S8F7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:10.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:00.952" grpc.time_ms=6.261 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 263.237297] gitaly[914]: time="2026-10-04T11:37:01.030Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YT58X1KC57BC4B317YQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:31.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:01.029" grpc.time_ms=0.605 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 263.241819] gitaly[914]: time="2026-10-04T11:37:01.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7YT58X1KC57BC4B317YQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:11.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:01.049" grpc.time_ms=6.226 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 263.286353] gitaly[914]: time="2026-10-04T11:37:01.150Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7YXQ7E645BY5DKSSMS0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.144" grpc.time_ms=6.049 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1943gitlab # [ 263.287047] gitaly[914]: time="2026-10-04T11:37:01.196Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YZ0MF1P0A4J7PPAN4HY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.189" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1944gitlab # [ 263.287569] gitaly[914]: time="2026-10-04T11:37:01.196Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YZ0MF1P0A4J7PPAN4HY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.189" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1945gitlab # [ 263.288254] gitaly[914]: time="2026-10-04T11:37:01.197Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YZ0MF1P0A4J7PPAN4HY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.189" grpc.time_ms=7.896 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1946gitlab # [ 263.330914] gitaly[914]: time="2026-10-04T11:37:01.240Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=399 command.spawn_token_fork_ms=395 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T11:37:10.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:00.839" grpc.time_ms=400.471 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 263.331743] gitaly[914]: time="2026-10-04T11:37:01.275Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:31.173" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:01.274" grpc.time_ms=0.698 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 263.332599] gitaly[914]: time="2026-10-04T11:37:01.282Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=154 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-04T11:37:31.179" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:01.279" grpc.time_ms=2.798 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 263.338608] gitaly[914]: time="2026-10-04T11:37:01.309Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:11.272" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:01.302" grpc.time_ms=6.688 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1951gitlab # [ 263.537882] nixbot[2696]: INFO: ::ffff:127.0.0.1:57344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.06 seconds)1953gitlab # [ 263.658972] gitaly[914]: time="2026-10-04T11:37:01.697Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-04T11:37:31.578" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:01.678" grpc.time_ms=18.823 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 263.674746] gitaly[914]: time="2026-10-04T11:37:01.714Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7SHBQQRD6WYG4G7SW4X2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-04T11:37:31.599" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:01.700" grpc.time_ms=13.971 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 263.686228] sidekiq-cluster[2570]: {"severity":"WARN","time":"2026-10-04T11:37:01.725Z","class":"CreatePipelineWorker","correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"bcf642e8a4691223eedc542a96536b9bb612f2f8","after":"d491feb0b1425b7570c0949701f208f527bdd677","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d491feb0b1425b7570c0949701f208f527bdd677","ref":"refs/heads/master"},"retry":0}1956gitlab # [ 263.690556] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a2416e502fe60a5ec8a8beb1","created_at":"2026-10-04T11:36:59.014Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8643c3164c45025dcecc5fd4891bd5081a04848ca8b195bae74b67d9859b81c9","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:59.016Z","job_size_bytes":467,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a2416e502fe60a5ec8a8beb1: done: 0.910766 sec","job_status":"done","queue_duration_s":1.802942,"scheduling_latency_s":1.802957,"gitaly_calls":7,"gitaly_duration_s":0.458967,"redis_calls":33,"redis_duration_s":0.007641,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000575,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004682,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.427975,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.910766,"completed_at":"2026-10-04T11:37:01.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015282,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1957gitlab # [ 263.756788] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.731Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"6c0b366a-aa45-4f2f-b7c6-5c02cbbe2acd\"}"],"class":"WebHookWorker","jid":"1cb303b5cb769e264b06300e","created_at":"2026-10-04T11:36:59.026Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:021945a4855f3168c0bfbdf949eadbfa55465211bbac0493a52946f41dff253a","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:59.027Z","job_size_bytes":1749,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1cb303b5cb769e264b06300e: start","job_status":"start","queue_duration_s":2.703852,"scheduling_latency_s":2.70387}1958gitlab # [ 263.757777] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.769Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"6c0b366a-aa45-4f2f-b7c6-5c02cbbe2acd\"}"],"class":"WebHookWorker","jid":"1cb303b5cb769e264b06300e","created_at":"2026-10-04T11:36:59.026Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-33e2a2d6a2274429","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:021945a4855f3168c0bfbdf949eadbfa55465211bbac0493a52946f41dff253a","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:59.027Z","job_size_bytes":1749,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1cb303b5cb769e264b06300e: done: 0.038318 sec","job_status":"done","queue_duration_s":2.703852,"scheduling_latency_s":2.70387,"redis_calls":14,"redis_duration_s":0.003001,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.00068,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007747912000013457,"cpu_s":0.02134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.038318,"completed_at":"2026-10-04T11:37:01.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1959gitlab # [ 263.820512] nixbot[2696]: INFO: ::ffff:127.0.0.1:57352 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1960gitlab # [ 263.821377] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 531961gitlab # [ 263.821944] gitaly[914]: time="2026-10-04T11:37:01.832Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B7ZJK9624C23WXT9K9XDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.826" grpc.time_ms=6.39 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 263.822720] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9b440899492a091e3a7c45d5","created_at":"2026-10-04T11:36:59.156Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-5498e294d8924f34","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:59.162Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9b440899492a091e3a7c45d5: start","job_status":"start","queue_duration_s":2.610274,"scheduling_latency_s":2.610318}1963gitlab # [ 263.823427] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"9b440899492a091e3a7c45d5","created_at":"2026-10-04T11:36:59.156Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-5498e294d8924f34","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-04T11:36:59.162Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-9b440899492a091e3a7c45d5: done: 0.056172 sec","job_status":"done","queue_duration_s":2.610274,"scheduling_latency_s":2.610318,"redis_calls":19,"redis_duration_s":0.008959,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000725,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00243,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003589,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008159138000000002,"duration_s":0.056172,"completed_at":"2026-10-04T11:37:01.828Z","load_balancing_strategy":"primary","db_duration_s":0.007222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 263.884773] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.830Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7a4d075d25d4d801f65bd0ec"],"class":"WebHooks::LogExecutionWorker","jid":"f70030ee28230613086da5dd","created_at":"2026-10-04T11:37:00.173Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-3c3f9e493d6248a8","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad5dfaba6fdcc2e259bcc9d46275536d92a6f8d546584dc264e7727a42ad430f","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:00.179Z","job_size_bytes":2592,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f70030ee28230613086da5dd: start","job_status":"start","queue_duration_s":1.651255,"scheduling_latency_s":1.651274}1965gitlab # [ 263.885740] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.869Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7a4d075d25d4d801f65bd0ec"],"class":"WebHooks::LogExecutionWorker","jid":"f70030ee28230613086da5dd","created_at":"2026-10-04T11:37:00.173Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-3c3f9e493d6248a8","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad5dfaba6fdcc2e259bcc9d46275536d92a6f8d546584dc264e7727a42ad430f","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:00.179Z","job_size_bytes":2592,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f70030ee28230613086da5dd: done: 0.03933 sec","job_status":"done","queue_duration_s":1.651255,"scheduling_latency_s":1.651274,"redis_calls":10,"redis_duration_s":0.0023049999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000334,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222654,"duration_s":0.03933,"completed_at":"2026-10-04T11:37:01.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1966gitlab # [ 263.944258] gitaly[914]: time="2026-10-04T11:37:01.886Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7ZMA96GBVCX6G3HYPYPV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.879" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1967gitlab # [ 263.944943] gitlab-workhorse[824]: time="2026-10-04T11:37:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671968gitlab # [ 263.945647] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 521969gitlab # [ 263.946310] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:01.871Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d67b53bf59ceeb357aa3e12e","created_at":"2026-10-04T11:37:00.865Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-48877899c8864c16","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:00.869Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d67b53bf59ceeb357aa3e12e: start","job_status":"start","queue_duration_s":1.001815,"scheduling_latency_s":1.00183}1970gitlab # [ 263.989306] gitaly[914]: time="2026-10-04T11:37:01.886Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7ZMA96GBVCX6G3HYPYPV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.879" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1971gitlab # [ 263.990042] gitaly[914]: time="2026-10-04T11:37:01.886Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7ZMA96GBVCX6G3HYPYPV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:01.879" grpc.time_ms=6.772 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1972gitlab # [ 263.990686] gitaly[914]: time="2026-10-04T11:37:01.958Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:01.958" grpc.time_ms=0.489 pid=914 span.kind=server system=grpc1973gitlab # [ 263.991450] gitaly[914]: time="2026-10-04T11:37:01.977Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:01.977" grpc.time_ms=0.388 pid=914 span.kind=server system=grpc1974gitlab # [ 263.993868] gitaly[914]: time="2026-10-04T11:37:02.015Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:02.014" grpc.time_ms=0.362 pid=914 span.kind=server system=grpc1975gitlab # [ 264.013098] gitaly[914]: time="2026-10-04T11:37:02.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7ZPQ5X02Y40NH5KPX7Z4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:02.046" grpc.time_ms=5.694 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1976gitlab # [ 264.015874] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1411977gitlab # [ 264.068236] gitaly[914]: time="2026-10-04T11:37:02.107Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K diskcache=52a92596-d6bf-419c-9cc1-507133fb8700 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:31.838" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:01.938" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 264.077282] gitaly[914]: time="2026-10-04T11:37:02.116Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6896 command.oublock=0 command.real_time_ms=160 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:31.838" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:01.938" grpc.time_ms=169.438 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 264.136178] gitaly[914]: time="2026-10-04T11:37:02.175Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:32.074" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:02.174" grpc.time_ms=0.956 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 264.162145] gitaly[914]: time="2026-10-04T11:37:02.201Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7YHSQKPJ5DFN8MB4710K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:32.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:02.201" grpc.time_ms=0.494 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 264.169369] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.208Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d67b53bf59ceeb357aa3e12e","created_at":"2026-10-04T11:37:00.865Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-48877899c8864c16","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:00.869Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2570,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d67b53bf59ceeb357aa3e12e: rescheduled"}1982gitlab # [ 264.174446] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.213Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d67b53bf59ceeb357aa3e12e","created_at":"2026-10-04T11:37:00.865Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-48877899c8864c16","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:00.869Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d67b53bf59ceeb357aa3e12e: done: 0.342897 sec","job_status":"done","queue_duration_s":1.001815,"scheduling_latency_s":1.00183,"gitaly_calls":3,"gitaly_duration_s":0.185879,"redis_calls":67,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014553,"redis_read_bytes":149,"redis_write_bytes":18096,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000508,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001111,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004315,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004705,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000702,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000883,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109893,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.313620307,"duration_s":0.342897,"completed_at":"2026-10-04T11:37:02.213Z","load_balancing_strategy":"primary","db_duration_s":0.030819,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1983gitlab # [ 264.195849] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.215Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1cb303b5cb769e264b06300e"],"class":"WebHooks::LogExecutionWorker","jid":"2d3e823bb2aeec527261ecee","created_at":"2026-10-04T11:37:01.759Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-22f4483db3074469","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6e2affbc5c1a47056bc5d1d0de617036e3f7aa3452423631ef349ba61f198b91","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:01.761Z","job_size_bytes":2592,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2d3e823bb2aeec527261ecee: start","job_status":"start","queue_duration_s":0.453694,"scheduling_latency_s":0.453717}1984gitlab # [ 264.211759] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.235Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1cb303b5cb769e264b06300e"],"class":"WebHooks::LogExecutionWorker","jid":"2d3e823bb2aeec527261ecee","created_at":"2026-10-04T11:37:01.759Z","trace_propagation_headers":{"sentry-trace":"05c23e202e1d4af2a9ceba1a038f1e0c-22f4483db3074469","baggage":"sentry-trace_id=05c23e202e1d4af2a9ceba1a038f1e0c,sentry-release=Unknown"},"correlation_id":"01M43B7SHBQQRD6WYG4G7SW4X2","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6e2affbc5c1a47056bc5d1d0de617036e3f7aa3452423631ef349ba61f198b91","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:01.761Z","job_size_bytes":2592,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2d3e823bb2aeec527261ecee: done: 0.019849 sec","job_status":"done","queue_duration_s":0.453694,"scheduling_latency_s":0.453717,"redis_calls":7,"redis_duration_s":0.001491,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019849,"completed_at":"2026-10-04T11:37:02.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985gitlab # [ 264.289841] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.236Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ed2b4213cc63359b66bdb315","created_at":"2026-10-04T11:37:01.815Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-1fc179d1882e497e","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:01.819Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ed2b4213cc63359b66bdb315: start","job_status":"start","queue_duration_s":0.41728,"scheduling_latency_s":0.417294}1986gitlab # [ 264.290566] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.304Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"ed2b4213cc63359b66bdb315","created_at":"2026-10-04T11:37:01.815Z","trace_propagation_headers":{"sentry-trace":"41b3cd4a3444415f97db47436e6744ce-1fc179d1882e497e","baggage":"sentry-trace_id=41b3cd4a3444415f97db47436e6744ce,sentry-release=Unknown"},"correlation_id":"01M43B68DXQP1XJ9QXP688BH5H","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:01.819Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-ed2b4213cc63359b66bdb315: done: 0.068361 sec","job_status":"done","queue_duration_s":0.41728,"scheduling_latency_s":0.417294,"redis_calls":11,"redis_duration_s":0.002516,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300876,"duration_s":0.068361,"completed_at":"2026-10-04T11:37:02.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 264.310640] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fa52745ff8e76adb899b4335","created_at":"2026-10-04T11:37:01.930Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:01.932Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fa52745ff8e76adb899b4335: start","job_status":"start","queue_duration_s":0.373391,"scheduling_latency_s":0.373407}1988gitlab # [ 264.326167] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fa52745ff8e76adb899b4335","created_at":"2026-10-04T11:37:01.930Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:01.932Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fa52745ff8e76adb899b4335: done: 0.028595 sec","job_status":"done","queue_duration_s":0.373391,"scheduling_latency_s":0.373407,"redis_calls":7,"redis_duration_s":0.00163,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028595,"completed_at":"2026-10-04T11:37:02.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005034,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1989gitlab # [ 264.367048] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e46e58b366a6345eb81b3ce2","created_at":"2026-10-04T11:37:02.122Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.124Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e46e58b366a6345eb81b3ce2: start","job_status":"start","queue_duration_s":0.211198,"scheduling_latency_s":0.211215}1990gitlab # [ 264.421984] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.359Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e46e58b366a6345eb81b3ce2","created_at":"2026-10-04T11:37:02.122Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.124Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e46e58b366a6345eb81b3ce2: done: 0.023102 sec","job_status":"done","queue_duration_s":0.211198,"scheduling_latency_s":0.211215,"redis_calls":7,"redis_duration_s":0.001463,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023102,"completed_at":"2026-10-04T11:37:02.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 264.463746] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.360Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e99324ec367c962124dbb8e8","created_at":"2026-10-04T11:37:02.131Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.133Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e99324ec367c962124dbb8e8: start","job_status":"start","queue_duration_s":0.226873,"scheduling_latency_s":0.22689}1992gitlab # [ 264.464599] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e99324ec367c962124dbb8e8","created_at":"2026-10-04T11:37:02.131Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.133Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e99324ec367c962124dbb8e8: done: 0.022631 sec","job_status":"done","queue_duration_s":0.226873,"scheduling_latency_s":0.22689,"redis_calls":7,"redis_duration_s":0.001466,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022631,"completed_at":"2026-10-04T11:37:02.382Z","load_balancing_strategy":"primary","db_duration_s":0.006955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 264.512646] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.384Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"baf5f9a81a9c4fdf8d8ed4d8","created_at":"2026-10-04T11:37:02.143Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.145Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-baf5f9a81a9c4fdf8d8ed4d8: start","job_status":"start","queue_duration_s":0.238794,"scheduling_latency_s":0.238811}1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'1995gitlab # [ 264.513454] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"baf5f9a81a9c4fdf8d8ed4d8","created_at":"2026-10-04T11:37:02.143Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.145Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-baf5f9a81a9c4fdf8d8ed4d8: done: 0.02211 sec","job_status":"done","queue_duration_s":0.238794,"scheduling_latency_s":0.238811,"redis_calls":10,"redis_duration_s":0.002235,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000847,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02211,"completed_at":"2026-10-04T11:37:02.406Z","load_balancing_strategy":"primary","db_duration_s":0.004802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1996gitlab # [ 264.532338] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"45c85051d330f7f7a444ef55","created_at":"2026-10-04T11:37:02.146Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.148Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-45c85051d330f7f7a444ef55: start","job_status":"start","queue_duration_s":0.259211,"scheduling_latency_s":0.259226}1997gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.07 seconds)1998gitlab # [ 264.580293] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.425Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"45c85051d330f7f7a444ef55","created_at":"2026-10-04T11:37:02.146Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.148Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-45c85051d330f7f7a444ef55: done: 0.018479 sec","job_status":"done","queue_duration_s":0.259211,"scheduling_latency_s":0.259226,"redis_calls":7,"redis_duration_s":0.00164,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018479,"completed_at":"2026-10-04T11:37:02.425Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 264.585348] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0d062fbf6a03ddc2ab729dbe","created_at":"2026-10-04T11:37:02.148Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.151Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0d062fbf6a03ddc2ab729dbe: start","job_status":"start","queue_duration_s":0.275521,"scheduling_latency_s":0.275536}2000gitlab # [ 264.628905] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0d062fbf6a03ddc2ab729dbe","created_at":"2026-10-04T11:37:02.148Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.151Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0d062fbf6a03ddc2ab729dbe: done: 0.016017 sec","job_status":"done","queue_duration_s":0.275521,"scheduling_latency_s":0.275536,"redis_calls":8,"redis_duration_s":0.001695,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016017,"completed_at":"2026-10-04T11:37:02.443Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 264.639360] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.444Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b2648ee820e3672c4b8cc71d","created_at":"2026-10-04T11:37:02.152Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.154Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b2648ee820e3672c4b8cc71d: start","job_status":"start","queue_duration_s":0.289791,"scheduling_latency_s":0.289806}2002gitlab # [ 264.656376] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.458Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b2648ee820e3672c4b8cc71d","created_at":"2026-10-04T11:37:02.152Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.154Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b2648ee820e3672c4b8cc71d: done: 0.014405 sec","job_status":"done","queue_duration_s":0.289791,"scheduling_latency_s":0.289806,"redis_calls":7,"redis_duration_s":0.0014010000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014405,"completed_at":"2026-10-04T11:37:02.458Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 264.706630] nixbot[2696]: INFO: ::ffff:127.0.0.1:57366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK2004gitlab # [ 264.707457] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.459Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"303fc915b2d456957e092960","created_at":"2026-10-04T11:37:02.155Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.156Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-303fc915b2d456957e092960: start","job_status":"start","queue_duration_s":0.303049,"scheduling_latency_s":0.303065}2005gitlab # [ 264.711925] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.477Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"303fc915b2d456957e092960","created_at":"2026-10-04T11:37:02.155Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.156Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-303fc915b2d456957e092960: done: 0.017391 sec","job_status":"done","queue_duration_s":0.303049,"scheduling_latency_s":0.303065,"redis_calls":7,"redis_duration_s":0.001495,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017391,"completed_at":"2026-10-04T11:37:02.477Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 264.754970] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.478Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cad1c1665e925f616b05026e","created_at":"2026-10-04T11:37:02.157Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.159Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cad1c1665e925f616b05026e: start","job_status":"start","queue_duration_s":0.319481,"scheduling_latency_s":0.319495}2007gitlab # [ 264.793886] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"cad1c1665e925f616b05026e","created_at":"2026-10-04T11:37:02.157Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.159Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-cad1c1665e925f616b05026e: done: 0.008954 sec","job_status":"done","queue_duration_s":0.319481,"scheduling_latency_s":0.319495,"redis_calls":7,"redis_duration_s":0.000913,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008954,"completed_at":"2026-10-04T11:37:02.487Z","load_balancing_strategy":"primary","db_duration_s":0.000243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 264.801680] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cf6e0836ef34f190278cbb2f","created_at":"2026-10-04T11:37:02.159Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.161Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cf6e0836ef34f190278cbb2f: start","job_status":"start","queue_duration_s":0.327092,"scheduling_latency_s":0.327106}2009gitlab # [ 264.815715] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cf6e0836ef34f190278cbb2f","created_at":"2026-10-04T11:37:02.159Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.161Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cf6e0836ef34f190278cbb2f: done: 0.021126 sec","job_status":"done","queue_duration_s":0.327092,"scheduling_latency_s":0.327106,"redis_calls":7,"redis_duration_s":0.001656,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021126,"completed_at":"2026-10-04T11:37:02.509Z","load_balancing_strategy":"primary","db_duration_s":0.002287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010gitlab # [ 264.876928] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.511Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e8cbc1bc623ec4e953bffc1c","created_at":"2026-10-04T11:37:02.208Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.210Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e8cbc1bc623ec4e953bffc1c: start","job_status":"start","queue_duration_s":0.301648,"scheduling_latency_s":0.301687}2011gitlab # [ 264.877673] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:02.541Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e8cbc1bc623ec4e953bffc1c","created_at":"2026-10-04T11:37:02.208Z","trace_propagation_headers":{"sentry-trace":"bdd61710f89343c5b1f79545cf3f3742-b414be47be7e404b","baggage":"sentry-trace_id=bdd61710f89343c5b1f79545cf3f3742,sentry-release=Unknown"},"correlation_id":"01M43B7YHSQKPJ5DFN8MB4710K","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:02.210Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e8cbc1bc623ec4e953bffc1c: done: 0.029416 sec","job_status":"done","queue_duration_s":0.301648,"scheduling_latency_s":0.301687,"redis_calls":8,"redis_duration_s":0.0021000000000000003,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029416,"completed_at":"2026-10-04T11:37:02.541Z","load_balancing_strategy":"primary","db_duration_s":0.00339,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2012gitlab # [ 264.982778] gitaly[914]: time="2026-10-04T11:37:03.021Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M43B7ZV6M1QAC6KPP16P8V90 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:03.003" pid=914 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2013gitlab # [ 264.983717] gitaly[914]: time="2026-10-04T11:37:03.022Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7ZV6M1QAC6KPP16P8V90 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:03.003" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2014gitlab # [ 264.985216] gitlab-workhorse[824]: time="2026-10-04T11:37:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162015gitlab # [ 264.985993] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 9682016gitlab # [ 264.986767] gitaly[914]: time="2026-10-04T11:37:03.022Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M43B7ZV6M1QAC6KPP16P8V90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T11:37:03.003" grpc.time_ms=19.41 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2017gitlab # [ 265.146811] gitaly[914]: time="2026-10-04T11:37:03.186Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:33.184" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:03.184" grpc.time_ms=1.135 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 265.189243] gitaly[914]: time="2026-10-04T11:37:03.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-04T11:37:33.214" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:03.215" grpc.time_ms=13.554 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 265.210178] gitaly[914]: time="2026-10-04T11:37:03.249Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:13.207" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:03.238" grpc.time_ms=11.202 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 265.242446] gitaly[914]: time="2026-10-04T11:37:03.281Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T11:37:13.250" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:37:03.281" grpc.time_ms=0.488 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 265.263932] gitaly[914]: time="2026-10-04T11:37:03.303Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T11:37:13.262" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:03.292" grpc.time_ms=10.353 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 265.319517] gitaly[914]: time="2026-10-04T11:37:03.359Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:03.358" grpc.time_ms=0.47 pid=914 span.kind=server system=grpc2023gitlab # [ 265.369173] gitaly[914]: time="2026-10-04T11:37:03.408Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:03.407" grpc.time_ms=0.568 pid=914 span.kind=server system=grpc2024gitlab # [ 265.392626] gitaly[914]: time="2026-10-04T11:37:03.432Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW diskcache=0a352129-61da-4c28-80ba-3021b367853d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T11:37:13.275" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:37:03.306" pid=914 ref=refs/keep-around/d491feb0b1425b7570c0949701f208f527bdd677 remote_ip="2001:db8:1::1" revision=d491feb0b1425b7570c0949701f208f527bdd677 span.kind=server system=grpc username=root2025gitlab # [ 265.398928] gitaly[914]: time="2026-10-04T11:37:03.438Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:33.436" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:03.437" grpc.time_ms=0.701 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # [ 265.409915] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.448Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cc7537f06db95d17e8e78165","created_at":"2026-10-04T11:37:03.441Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-bec16fd0831d4bd1","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.445Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cc7537f06db95d17e8e78165: start","job_status":"start","queue_duration_s":0.002217,"scheduling_latency_s":0.002274}2027gitlab # [ 265.431771] gitaly[914]: time="2026-10-04T11:37:03.471Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=118 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5282 command.oublock=8 command.real_time_ms=117 command.spawn_token_fork_ms=0 command.system_time_ms=79 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T11:37:13.275" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T11:37:03.306" grpc.time_ms=125.879 pid=914 ref=refs/keep-around/d491feb0b1425b7570c0949701f208f527bdd677 remote_ip="2001:db8:1::1" revision=d491feb0b1425b7570c0949701f208f527bdd677 span.kind=server system=grpc username=root2028gitlab # [ 265.467942] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.506Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cc7537f06db95d17e8e78165","created_at":"2026-10-04T11:37:03.441Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-bec16fd0831d4bd1","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.445Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cc7537f06db95d17e8e78165: done: 0.058876 sec","job_status":"done","queue_duration_s":0.002217,"scheduling_latency_s":0.002274,"redis_calls":7,"redis_duration_s":0.002265,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058876,"completed_at":"2026-10-04T11:37:03.506Z","load_balancing_strategy":"primary","db_duration_s":0.021728,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2029gitlab # [ 265.469999] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.509Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"379c850d6dfe91a9d8906296","created_at":"2026-10-04T11:37:03.447Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-bec16fd0831d4bd1","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.449Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-379c850d6dfe91a9d8906296: start","job_status":"start","queue_duration_s":0.05944,"scheduling_latency_s":0.05946}2030gitlab # [ 265.559204] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4982031gitlab # [ 265.563856] nixbot[2696]: {"ts": "2026-10-04T11:37:03.602Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 \"HTTP/1.1 201 Created\""}2032gitlab # [ 265.576119] nixbot[2696]: {"ts": "2026-10-04T11:37:03.615Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-d491feb0b142-5"}2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677'2034gitlab # [ 265.586911] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.625Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"379c850d6dfe91a9d8906296","created_at":"2026-10-04T11:37:03.447Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-bec16fd0831d4bd1","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.449Z","job_size_bytes":65,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-379c850d6dfe91a9d8906296: done: 0.116694 sec","job_status":"done","queue_duration_s":0.05944,"scheduling_latency_s":0.05946,"redis_calls":10,"redis_duration_s":0.0028190000000000003,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001276,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.116694,"completed_at":"2026-10-04T11:37:03.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 265.627173] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.666Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a483313cd09580afd7e9b976","created_at":"2026-10-04T11:37:03.572Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-bec16fd0831d4bd1","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.578Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a483313cd09580afd7e9b976: start","job_status":"start","queue_duration_s":0.087964,"scheduling_latency_s":0.087998}2036gitlab # [ 265.652193] nixbot[2696]: INFO: ::ffff:127.0.0.1:57376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 200 OK2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d491feb0b1425b7570c0949701f208f527bdd677', in 0.04 seconds)2038(finished: subtest: push delivers the webhook, in 54.05 seconds)2039subtest: eval and build post commit statuses2040gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses2041gitlab # [ 265.696204] nixbot[2696]: {"ts": "2026-10-04T11:37:03.735Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-d491feb0b142-5", "argv0": "bwrap"}2042gitlab # [ 265.703778] gitaly[914]: time="2026-10-04T11:37:03.743Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:33.641" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:03.742" grpc.time_ms=0.898 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043gitlab # [ 265.720409] gitaly[914]: time="2026-10-04T11:37:03.760Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B81F19PQD21MRXX2JCF74 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:33.158" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:03.759" grpc.time_ms=0.526 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 265.754448] gitaly[914]: time="2026-10-04T11:37:03.794Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B80VW73AX0SCDPVCZDXNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:33.693" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:03.793" grpc.time_ms=0.551 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses, in 0.11 seconds)2046gitlab # [ 265.766285] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 842047gitlab # [ 265.773866] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.813Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a483313cd09580afd7e9b976","created_at":"2026-10-04T11:37:03.572Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-bec16fd0831d4bd1","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.578Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a483313cd09580afd7e9b976: done: 0.146679 sec","job_status":"done","queue_duration_s":0.087964,"scheduling_latency_s":0.087998,"gitaly_calls":2,"gitaly_duration_s":0.017791,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013462,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001455,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000808,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000218,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006989,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000206,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001278,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080669,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.107025893,"duration_s":0.146679,"completed_at":"2026-10-04T11:37:03.812Z","load_balancing_strategy":"primary","db_duration_s":0.034871,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048gitlab # [ 265.796289] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7ac9b31d56e9570673173820","created_at":"2026-10-04T11:37:03.720Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-160885bcee5d4416","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.723Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7ac9b31d56e9570673173820: start","job_status":"start","queue_duration_s":0.090695,"scheduling_latency_s":0.090715}2049gitlab # [ 265.797259] nix-daemon[2863]: accepted connection from pid 3718, user nixbot2050gitlab # [ 265.803409] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:03.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7ac9b31d56e9570673173820","created_at":"2026-10-04T11:37:03.720Z","trace_propagation_headers":{"sentry-trace":"7dda4917e0a44e0b8823385ecbf7a855-160885bcee5d4416","baggage":"sentry-trace_id=7dda4917e0a44e0b8823385ecbf7a855,sentry-release=Unknown"},"correlation_id":"01M43B80VW73AX0SCDPVCZDXNW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:03.723Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7ac9b31d56e9570673173820: done: 0.027995 sec","job_status":"done","queue_duration_s":0.090695,"scheduling_latency_s":0.090715,"redis_calls":7,"redis_duration_s":0.0010769999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027995,"completed_at":"2026-10-04T11:37:03.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses2052gitlab # [ 266.877323] gitaly[914]: time="2026-10-04T11:37:04.916Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B82JE36GYBRK9PPXQMXMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:34.313" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:04.914" grpc.time_ms=1.061 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 266.917703] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1092054gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses, in 0.16 seconds)2055gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses2056gitlab # [ 268.032165] gitaly[914]: time="2026-10-04T11:37:06.070Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B83PKX009TCGKVGM1QWDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:36.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:06.069" grpc.time_ms=1.178 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 268.071273] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1062058gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses, in 0.15 seconds)2059gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses2060gitlab # [ 269.178881] gitaly[914]: time="2026-10-04T11:37:07.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B84TKRFEHT4BTNH79HA1J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:37.215" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:07.216" grpc.time_ms=1.067 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 269.200188] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 822062gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses, in 0.13 seconds)2063gitlab # [ 270.087462] nix-daemon[2863]: accepted connection from pid 3748, user nixbot2064gitlab # [ 270.101994] nix-daemon[2863]: accepted connection from pid 3718, user nixbot2065gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses2066gitlab # [ 270.214118] gitaly[914]: time="2026-10-04T11:37:08.252Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:38.250" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.251" grpc.time_ms=0.999 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 270.251551] gitaly[914]: time="2026-10-04T11:37:08.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:18.250" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.280" grpc.time_ms=10.146 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 270.288250] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.326Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1c7179c46d95f2ec3a960c4d","created_at":"2026-10-04T11:37:08.319Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-48fc905c0b9a4b09","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.324Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1c7179c46d95f2ec3a960c4d: start","job_status":"start","queue_duration_s":0.002131,"scheduling_latency_s":0.002183}2069gitlab # [ 270.319978] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1762070gitlab # [ 270.323865] nixbot[2696]: {"ts": "2026-10-04T11:37:08.363Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 \"HTTP/1.1 201 Created\""}2071gitlab # [ 270.346122] gitaly[914]: time="2026-10-04T11:37:08.385Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B85XYYHDRFZE9Y40XVP0Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:38.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.384" grpc.time_ms=0.483 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 270.375458] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 1272073gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses, in 0.17 seconds)2074gitlab # [ 270.403378] gitaly[914]: time="2026-10-04T11:37:08.443Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:08.442" grpc.time_ms=0.663 pid=914 span.kind=server system=grpc2075gitlab # [ 270.430251] gitaly[914]: time="2026-10-04T11:37:08.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:08.469" grpc.time_ms=0.443 pid=914 span.kind=server system=grpc2076gitlab # [ 270.457627] gitaly[914]: time="2026-10-04T11:37:08.497Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T11:37:08.496" grpc.time_ms=0.426 pid=914 span.kind=server system=grpc2077gitlab # [ 270.467833] gitaly[914]: time="2026-10-04T11:37:08.507Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:38.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.420" operations="[repack_refs]" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 270.477319] gitaly[914]: time="2026-10-04T11:37:08.508Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:38.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.420" pid=914 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-04 11:35:58.5448635 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2079gitlab # [ 270.493477] gitaly[914]: time="2026-10-04T11:37:08.533Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:38.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.420" pid=914 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2080gitlab # [ 270.494277] gitaly[914]: time="2026-10-04T11:37:08.533Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B860H3M71E75ECN7TAJ7Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:38.532" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.533" grpc.time_ms=0.54 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 270.516986] gitaly[914]: time="2026-10-04T11:37:08.556Z" level=info msg="optimized repository" clean_stale_data_time=15.987228ms clean_work_trees_time=23.236194ms commit_graph_time="4.75µs" correlation_id=01M43B85TPZY6E7698JKJ39SZ9 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.749µs" pid=914 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="5.588µs" storage_name=default system=housekeeping total_time=39.440487ms2082gitlab # [ 270.517770] gitaly[914]: time="2026-10-04T11:37:08.556Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:38.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.420" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 270.531844] gitaly[914]: time="2026-10-04T11:37:08.571Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 diskcache=a2800538-9892-4d5f-9035-689353077db0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:38.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.420" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 270.542356] gitaly[914]: time="2026-10-04T11:37:08.571Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8310 command.oublock=0 command.real_time_ms=98 command.spawn_token_fork_ms=0 command.system_time_ms=67 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T11:37:38.319" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.420" grpc.time_ms=151.254 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 270.543061] gitaly[914]: time="2026-10-04T11:37:08.575Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B860H3M71E75ECN7TAJ7Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:18.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:08.568" grpc.time_ms=6.372 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 270.587973] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2582087gitlab # [ 270.589074] nixbot[2696]: {"ts": "2026-10-04T11:37:08.628Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 \"HTTP/1.1 201 Created\""}2088gitlab # [ 270.618084] gitaly[914]: time="2026-10-04T11:37:08.657Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:38.556" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.656" grpc.time_ms=0.719 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 270.650863] gitaly[914]: time="2026-10-04T11:37:08.690Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B8691XD7B1G0JTJ2XZM16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:38.088" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.689" grpc.time_ms=0.647 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 270.656946] gitaly[914]: time="2026-10-04T11:37:08.696Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:38.594" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.695" grpc.time_ms=0.988 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 270.665711] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.705Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4e7c7c3e7c1e1007e0a1adb6","created_at":"2026-10-04T11:37:08.703Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"1c7179c46d95f2ec3a960c4d","job_size_bytes":3,"pid":2570,"job_status":"deduplicated","message":"PipelineProcessWorker JID-4e7c7c3e7c1e1007e0a1adb6: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2092gitlab # [ 270.667167] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.706Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1c7179c46d95f2ec3a960c4d","created_at":"2026-10-04T11:37:08.319Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-48fc905c0b9a4b09","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.324Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2570,"job_status":"rescheduled","message":"PipelineProcessWorker JID-1c7179c46d95f2ec3a960c4d: rescheduled"}2093gitlab # [ 270.672750] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.712Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1c7179c46d95f2ec3a960c4d","created_at":"2026-10-04T11:37:08.319Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-48fc905c0b9a4b09","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.324Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1c7179c46d95f2ec3a960c4d: done: 0.385845 sec","job_status":"done","queue_duration_s":0.002131,"scheduling_latency_s":0.002183,"gitaly_calls":3,"gitaly_duration_s":0.172402,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.024724,"redis_read_bytes":239,"redis_write_bytes":21785,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002377,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001804,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003184,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.010212,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000385,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00046,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003925,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.143199,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.331028105,"duration_s":0.385845,"completed_at":"2026-10-04T11:37:08.712Z","load_balancing_strategy":"primary","db_duration_s":0.060423,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2094gitlab # [ 270.710803] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b2b3288b2eb62e9b727ecca0","created_at":"2026-10-04T11:37:08.413Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.415Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b2b3288b2eb62e9b727ecca0: start","job_status":"start","queue_duration_s":0.297691,"scheduling_latency_s":0.29771}2095gitlab # [ 270.763861] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.740Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b2b3288b2eb62e9b727ecca0","created_at":"2026-10-04T11:37:08.413Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.415Z","job_size_bytes":23,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b2b3288b2eb62e9b727ecca0: done: 0.02744 sec","job_status":"done","queue_duration_s":0.297691,"scheduling_latency_s":0.29771,"redis_calls":7,"redis_duration_s":0.001086,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02744,"completed_at":"2026-10-04T11:37:08.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00517,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2096gitlab # [ 270.804887] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.741Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a9e64e43aff8ea582202c43e","created_at":"2026-10-04T11:37:08.577Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.580Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a9e64e43aff8ea582202c43e: start","job_status":"start","queue_duration_s":0.161721,"scheduling_latency_s":0.161737}2097gitlab # [ 270.805800] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.758Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a9e64e43aff8ea582202c43e","created_at":"2026-10-04T11:37:08.577Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.580Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a9e64e43aff8ea582202c43e: done: 0.016856 sec","job_status":"done","queue_duration_s":0.161721,"scheduling_latency_s":0.161737,"redis_calls":7,"redis_duration_s":0.001066,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016856,"completed_at":"2026-10-04T11:37:08.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 270.854418] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.759Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e466c453121c2a655abf1d19","created_at":"2026-10-04T11:37:08.611Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.615Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e466c453121c2a655abf1d19: start","job_status":"start","queue_duration_s":0.144601,"scheduling_latency_s":0.144614}2099gitlab # [ 270.855143] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.779Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e466c453121c2a655abf1d19","created_at":"2026-10-04T11:37:08.611Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.615Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e466c453121c2a655abf1d19: done: 0.019321 sec","job_status":"done","queue_duration_s":0.144601,"scheduling_latency_s":0.144614,"redis_calls":7,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019321,"completed_at":"2026-10-04T11:37:08.779Z","load_balancing_strategy":"primary","db_duration_s":0.004558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 270.875145] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5f1667575f7e024e52bcb981","created_at":"2026-10-04T11:37:08.622Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.623Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f1667575f7e024e52bcb981: start","job_status":"start","queue_duration_s":0.156928,"scheduling_latency_s":0.156944}2101gitlab # [ 270.916218] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.807Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5f1667575f7e024e52bcb981","created_at":"2026-10-04T11:37:08.622Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.623Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f1667575f7e024e52bcb981: done: 0.027428 sec","job_status":"done","queue_duration_s":0.156928,"scheduling_latency_s":0.156944,"redis_calls":10,"redis_duration_s":0.002297,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000774,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027428,"completed_at":"2026-10-04T11:37:08.807Z","load_balancing_strategy":"primary","db_duration_s":0.005513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2102gitlab # [ 270.957618] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.809Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"84f2e2c66f0eb95da5c476ab","created_at":"2026-10-04T11:37:08.623Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.624Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-84f2e2c66f0eb95da5c476ab: start","job_status":"start","queue_duration_s":0.184269,"scheduling_latency_s":0.184285}2103gitlab # [ 270.958446] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"84f2e2c66f0eb95da5c476ab","created_at":"2026-10-04T11:37:08.623Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.624Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-84f2e2c66f0eb95da5c476ab: done: 0.019473 sec","job_status":"done","queue_duration_s":0.184269,"scheduling_latency_s":0.184285,"redis_calls":7,"redis_duration_s":0.0015799999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019473,"completed_at":"2026-10-04T11:37:08.828Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2104gitlab # [ 271.011875] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"554d51134d14218830519a0f","created_at":"2026-10-04T11:37:08.625Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.626Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-554d51134d14218830519a0f: start","job_status":"start","queue_duration_s":0.203282,"scheduling_latency_s":0.203297}2105gitlab # [ 271.012665] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"554d51134d14218830519a0f","created_at":"2026-10-04T11:37:08.625Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.626Z","job_size_bytes":19,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-554d51134d14218830519a0f: done: 0.019207 sec","job_status":"done","queue_duration_s":0.203282,"scheduling_latency_s":0.203297,"redis_calls":8,"redis_duration_s":0.002205,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001801,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019207,"completed_at":"2026-10-04T11:37:08.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2106gitlab # [ 271.056130] gitaly[914]: time="2026-10-04T11:37:09.000Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T11:37:38.898" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:08.998" grpc.time_ms=1.118 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 271.056852] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.850Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8ed919eea309c266bbbc94eb","created_at":"2026-10-04T11:37:08.627Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.634Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8ed919eea309c266bbbc94eb: start","job_status":"start","queue_duration_s":0.215559,"scheduling_latency_s":0.215573}2108gitlab # [ 271.099846] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.865Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8ed919eea309c266bbbc94eb","created_at":"2026-10-04T11:37:08.627Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.634Z","job_size_bytes":66,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8ed919eea309c266bbbc94eb: done: 0.01532 sec","job_status":"done","queue_duration_s":0.215559,"scheduling_latency_s":0.215573,"redis_calls":7,"redis_duration_s":0.00159,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01532,"completed_at":"2026-10-04T11:37:08.865Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 271.140129] gitaly[914]: time="2026-10-04T11:37:09.042Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B85TPZY6E7698JKJ39SZ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:39.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:09.041" grpc.time_ms=0.736 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 271.140805] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.867Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4c2294e52597f9a35bcff7de","created_at":"2026-10-04T11:37:08.636Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.638Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4c2294e52597f9a35bcff7de: start","job_status":"start","queue_duration_s":0.22875,"scheduling_latency_s":0.228764}2111gitlab # [ 271.141292] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.889Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4c2294e52597f9a35bcff7de","created_at":"2026-10-04T11:37:08.636Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.638Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4c2294e52597f9a35bcff7de: done: 0.022077 sec","job_status":"done","queue_duration_s":0.22875,"scheduling_latency_s":0.228764,"redis_calls":7,"redis_duration_s":0.0015429999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022077,"completed_at":"2026-10-04T11:37:08.889Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2112gitlab # [ 271.187109] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.890Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d8a88afcd9056b7271794857","created_at":"2026-10-04T11:37:08.642Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.644Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d8a88afcd9056b7271794857: start","job_status":"start","queue_duration_s":0.246157,"scheduling_latency_s":0.246173}2113gitlab # [ 271.187751] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d8a88afcd9056b7271794857","created_at":"2026-10-04T11:37:08.642Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.644Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d8a88afcd9056b7271794857: done: 0.019171 sec","job_status":"done","queue_duration_s":0.246157,"scheduling_latency_s":0.246173,"redis_calls":7,"redis_duration_s":0.001526,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019171,"completed_at":"2026-10-04T11:37:08.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab # [ 271.243521] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b298011a6cae81dc0f982d92","created_at":"2026-10-04T11:37:08.644Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.645Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b298011a6cae81dc0f982d92: start","job_status":"start","queue_duration_s":0.265075,"scheduling_latency_s":0.265089}2115gitlab # [ 271.244197] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.920Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b298011a6cae81dc0f982d92","created_at":"2026-10-04T11:37:08.644Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.645Z","job_size_bytes":6,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b298011a6cae81dc0f982d92: done: 0.009437 sec","job_status":"done","queue_duration_s":0.265075,"scheduling_latency_s":0.265089,"redis_calls":7,"redis_duration_s":0.001566,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009437,"completed_at":"2026-10-04T11:37:08.920Z","load_balancing_strategy":"primary","db_duration_s":0.000437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 271.271252] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"791a734a63cfcaf9d2eb88fe","created_at":"2026-10-04T11:37:08.645Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.646Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-791a734a63cfcaf9d2eb88fe: start","job_status":"start","queue_duration_s":0.274348,"scheduling_latency_s":0.274361}2117gitlab # [ 271.313065] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.937Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"791a734a63cfcaf9d2eb88fe","created_at":"2026-10-04T11:37:08.645Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.646Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-791a734a63cfcaf9d2eb88fe: done: 0.01605 sec","job_status":"done","queue_duration_s":0.274348,"scheduling_latency_s":0.274361,"redis_calls":7,"redis_duration_s":0.001603,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01605,"completed_at":"2026-10-04T11:37:08.937Z","load_balancing_strategy":"primary","db_duration_s":0.003643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2118gitlab # [ 271.354096] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:08.938Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2ad4bfca40d69c6a63d50092","created_at":"2026-10-04T11:37:08.706Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.708Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ad4bfca40d69c6a63d50092: start","job_status":"start","queue_duration_s":0.230271,"scheduling_latency_s":0.230284}2119gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses2120gitlab # [ 271.354768] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:09.055Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"2ad4bfca40d69c6a63d50092","created_at":"2026-10-04T11:37:08.706Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-be04affa9733474c","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.708Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ad4bfca40d69c6a63d50092: done: 0.117068 sec","job_status":"done","queue_duration_s":0.230271,"scheduling_latency_s":0.230284,"gitaly_calls":2,"gitaly_duration_s":0.008489,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00715,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001288,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001085,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000339,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001602,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000252,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000393,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078776,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.090778856,"duration_s":0.117068,"completed_at":"2026-10-04T11:37:09.055Z","load_balancing_strategy":"primary","db_duration_s":0.029429,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2121gitlab # [ 271.409953] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:09.056Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2eebfe1883ae9d9b30765c95","created_at":"2026-10-04T11:37:08.985Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-1c304d5ead6c4688","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.987Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2eebfe1883ae9d9b30765c95: start","job_status":"start","queue_duration_s":0.06921,"scheduling_latency_s":0.069227}2122gitlab # [ 271.410730] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:09.078Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2eebfe1883ae9d9b30765c95","created_at":"2026-10-04T11:37:08.985Z","trace_propagation_headers":{"sentry-trace":"a8c0f608fa814c58a96ea20e7f2be7e0-1c304d5ead6c4688","baggage":"sentry-trace_id=a8c0f608fa814c58a96ea20e7f2be7e0,sentry-release=Unknown"},"correlation_id":"01M43B85TPZY6E7698JKJ39SZ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:08.987Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2eebfe1883ae9d9b30765c95: done: 0.021914 sec","job_status":"done","queue_duration_s":0.06921,"scheduling_latency_s":0.069227,"redis_calls":7,"redis_duration_s":0.0011840000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021914,"completed_at":"2026-10-04T11:37:09.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2123gitlab # [ 271.535066] gitaly[914]: time="2026-10-04T11:37:09.574Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M43B8691XD7B1G0JTJ2XZM16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T11:37:19.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T11:37:09.564" grpc.time_ms=9.822 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 271.576658] gitaly[914]: time="2026-10-04T11:37:09.616Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M43B872J6FG83TWWC4YRGH10 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T11:37:39.014" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T11:37:09.614" grpc.time_ms=1.424 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 271.600123] sidekiq-cluster[2570]: {"severity":"INFO","time":"2026-10-04T11:37:09.639Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"84b8f17be71bfd97613c7202","created_at":"2026-10-04T11:37:09.614Z","trace_propagation_headers":{"sentry-trace":"b4aefde45c7940538e6018ce77c96d83-faa73752cf25484c","baggage":"sentry-trace_id=b4aefde45c7940538e6018ce77c96d83,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M43B8691XD7B1G0JTJ2XZM16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T11:37:09.637Z","job_size_bytes":3,"pid":2570,"sidekiq_tid":"m82m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-84b8f17be71bfd97613c7202: start","job_status":"start","queue_duration_s":0.001653,"scheduling_latency_s":0.001691}2126gitlab # [ 271.629723] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 10272127gitlab # [ 271.633364] nixbot[2696]: {"ts": "2026-10-04T11:37:09.670Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d491feb0b1425b7570c0949701f208f527bdd677 \"HTTP/1.1 201 Created\""}2128gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses, in 0.29 seconds)2129gitlab # [ 271.664935] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/10/04:11:37:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d491feb0b1425b7570c0949701f208f527bdd677/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 2462130(finished: subtest: eval and build post commit statuses, in 6.02 seconds)2131(finished: run the VM test script, in 321.36 seconds)2132test script finished in 321.38s2133cleanup2134kill QemuMachine (pid 46)2135gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2136(finished: cleanup, in 1.87 seconds)2137additionally exposed symbols:2138 gitlab,2139 vlan1,2140 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2141[]2142[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-04T11:36:09.313Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2143[]2144[]2145[]2146[]2147[]2148[]2149[]2150[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-04T11:37:03.090111Z', 'started_at': '2026-10-04T11:37:03.610511Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2151[{'id': 5, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T11:37:03.507Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2152[{'id': 5, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T11:37:03.507Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2153[{'id': 5, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T11:37:03.507Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2154[{'id': 5, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T11:37:03.507Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2155[{'id': 5, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-04T11:37:03.507Z', 'started_at': None, 'finished_at': '2026-10-04T11:37:08.310Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2156[{'id': 5, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-04T11:37:03.507Z', 'started_at': None, 'finished_at': '2026-10-04T11:37:08.310Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'd491feb0b1425b7570c0949701f208f527bdd677', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-04T11:37:08.600Z', 'started_at': None, 'finished_at': '2026-10-04T11:37:09.593Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]