vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #460
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.Bo5yYKLp2n', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 54.74 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 33394315-53ad-4134-a0e4-501d8d833ce719gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2sis0k3zpkzj06k8whp92qdrr92n20j2-nixos-system-gitlab-test/init regInfo=/nix/store/77m9rv4v14cj9xwswblfva7mz1kjl05d-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 443405614 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000846] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000873] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000875] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000912] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002779] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002791] Using GB pages for direct mapping73gitlab # [ 0.002867] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002876] ACPI: Early table checksum verification disabled75gitlab # [ 0.002878] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002882] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002886] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002892] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002894] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002896] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002897] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002899] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002900] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002901] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002901] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002902] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002902] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002903] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003126] No NUMA configuration found90gitlab # [ 0.003127] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003130] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005690] Zone ranges:93gitlab # [ 0.005691] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005693] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005694] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005695] Device empty97gitlab # [ 0.005695] Movable zone start for each node98gitlab # [ 0.005696] Early memory node ranges99gitlab # [ 0.005696] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005698] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005698] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005699] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005721] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005983] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.109481] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.109899] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.109914] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.109944] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.109947] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.109949] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.109950] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.109951] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.109952] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.109955] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.109956] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.109961] TSC deadline timer available117gitlab # [ 0.109965] CPU topo: Max. logical packages: 1118gitlab # [ 0.109966] CPU topo: Max. logical dies: 1119gitlab # [ 0.109966] CPU topo: Max. dies per package: 1120gitlab # [ 0.109969] CPU topo: Max. threads per core: 1121gitlab # [ 0.109970] CPU topo: Num. cores per package: 4122gitlab # [ 0.109971] CPU topo: Num. threads per package: 4123gitlab # [ 0.109971] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.109995] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.110011] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.110014] kvm-guest: setup PV sched yield127gitlab # [ 0.110028] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.110030] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.110031] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.110032] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.110034] Booting paravirtualized kernel on KVM132gitlab # [ 0.110037] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.114492] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.116611] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.116659] kvm-guest: PV spinlocks enabled136gitlab # [ 0.116660] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.116663] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2sis0k3zpkzj06k8whp92qdrr92n20j2-nixos-system-gitlab-test/init regInfo=/nix/store/77m9rv4v14cj9xwswblfva7mz1kjl05d-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.116759] Unknown kernel command line parameters "regInfo=/nix/store/77m9rv4v14cj9xwswblfva7mz1kjl05d-closure-info/registration", will be passed to user space.139gitlab # [ 0.116772] random: crng init done140gitlab # [ 0.116773] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.125119] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.129427] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.129499] software IO TLB: area num 4.144gitlab # [ 0.199240] Fallback order for Node 0: 0145gitlab # [ 0.199248] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.199249] Policy zone: Normal147gitlab # [ 0.201687] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.210811] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.223728] allocated 12582912 bytes of page_ext150gitlab # [ 0.233637] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.233639] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.234470] Dynamic Preempt: lazy153gitlab # [ 0.234651] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.234652] rcu: RCU event tracing is enabled.155gitlab # [ 0.234653] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.234654] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.234655] Rude variant of Tasks RCU enabled.158gitlab # [ 0.234655] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.234656] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.234656] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.234676] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.234678] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.234679] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.239007] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.239336] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.239345] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.239447] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.242985] Console: colour VGA+ 80x25169gitlab # [ 0.242988] printk: legacy console [tty0] enabled170gitlab # [ 0.273720] printk: legacy console [ttyS0] enabled171gitlab # [ 0.384209] ACPI: Core revision 20250807172gitlab # [ 0.385140] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.386756] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.387819] x2apic enabled175gitlab # [ 0.388567] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.389541] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.390833] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.392353] kvm-guest: setup PV IPIs179gitlab # [ 0.393924] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.394990] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.396801] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.397884] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.398917] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.400798] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.401802] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.403798] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.404799] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.405797] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.406798] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.407798] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.408805] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.409799] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.410799] active return thunk: srso_alias_return_thunk194gitlab # [ 0.411818] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.412798] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.413798] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.414798] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.415798] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.416798] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.418692] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.419798] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.420798] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.421798] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.422798] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.423798] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.425615] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.455256] Freeing SMP alternatives memory: 44K208gitlab # [ 0.455801] pid_max: default: 32768 minimum: 301209gitlab # [ 0.456897] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.457900] landlock: Up and running.211gitlab # [ 0.458799] Yama: becoming mindful.212gitlab # [ 0.459811] LSM support for eBPF active213gitlab # [ 0.460730] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.461931] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.464715] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.465342] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.465804] ... version: 2218gitlab # [ 0.466595] ... bit width: 48219gitlab # [ 0.467391] ... generic counters: 6220gitlab # [ 0.467849] ... generic bitmap: 000000000000003f221gitlab # [ 0.468801] ... fixed-purpose counters: 0222gitlab # [ 0.469618] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.470565] ... value mask: 0000ffffffffffff224gitlab # [ 0.470800] ... max period: 00007fffffffffff225gitlab # [ 0.471760] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.472718] signal: max sigframe size: 3376227gitlab # [ 0.473493] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.473804] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.474910] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.480326] smp: Bringing up secondary CPUs ...231gitlab # [ 0.481204] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.481809] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.483870] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.485560] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.486196] Memory: 6011324K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.487159] devtmpfs: initialized237gitlab # [ 0.488009] x86/mm: Memory block size: 128MB238gitlab # [ 0.490955] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.492933] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.493897] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.495322] PM: RTC time: 23:56:23, date: 2026-10-17242gitlab # [ 0.498663] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.500949] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.501854] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.503884] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.504814] audit: initializing netlink subsys (disabled)247gitlab # [ 0.505991] audit: type=2000 audit(1792281384.778:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.506065] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.506803] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.507801] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.508801] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.509801] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.510829] cpuidle: using governor menu254gitlab # [ 0.512989] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.514076] PCI: Using configuration type 1 for base access256gitlab # [ 0.514802] PCI: Using configuration type 1 for extended access257gitlab # [ 0.515951] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.517094] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.518748] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.519737] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.520715] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.523781] ACPI: Added _OSI(Module Device)263gitlab # [ 0.524401] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.525802] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.528785] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.532057] ACPI: Interpreter enabled267gitlab # [ 0.532831] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.533592] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.533839] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.534801] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.535945] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.541240] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.542808] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.544352] acpiphp: Slot [3] registered275gitlab # [ 0.544832] acpiphp: Slot [4] registered276gitlab # [ 0.545589] acpiphp: Slot [5] registered277gitlab # [ 0.546822] acpiphp: Slot [6] registered278gitlab # [ 0.547542] acpiphp: Slot [7] registered279gitlab # [ 0.547830] acpiphp: Slot [8] registered280gitlab # [ 0.548583] acpiphp: Slot [9] registered281gitlab # [ 0.549840] acpiphp: Slot [10] registered282gitlab # [ 0.550579] acpiphp: Slot [11] registered283gitlab # [ 0.550830] acpiphp: Slot [12] registered284gitlab # [ 0.551594] acpiphp: Slot [13] registered285gitlab # [ 0.552821] acpiphp: Slot [14] registered286gitlab # [ 0.553594] acpiphp: Slot [15] registered287gitlab # [ 0.553821] acpiphp: Slot [16] registered288gitlab # [ 0.554581] acpiphp: Slot [17] registered289gitlab # [ 0.555820] acpiphp: Slot [18] registered290gitlab # [ 0.556583] acpiphp: Slot [19] registered291gitlab # [ 0.556821] acpiphp: Slot [20] registered292gitlab # [ 0.557583] acpiphp: Slot [21] registered293gitlab # [ 0.558820] acpiphp: Slot [22] registered294gitlab # [ 0.559593] acpiphp: Slot [23] registered295gitlab # [ 0.559821] acpiphp: Slot [24] registered296gitlab # [ 0.560552] acpiphp: Slot [25] registered297gitlab # [ 0.561821] acpiphp: Slot [26] registered298gitlab # [ 0.562602] acpiphp: Slot [27] registered299gitlab # [ 0.562820] acpiphp: Slot [28] registered300gitlab # [ 0.563560] acpiphp: Slot [29] registered301gitlab # [ 0.564836] acpiphp: Slot [30] registered302gitlab # [ 0.565603] acpiphp: Slot [31] registered303gitlab # [ 0.565813] PCI host bridge to bus 0000:00304gitlab # [ 0.566547] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.567801] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.568801] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.570801] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.571824] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.573813] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.575035] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.576299] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.578247] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.581853] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.582807] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.583801] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.584801] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.585800] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.586986] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.589829] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.591747] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.593068] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.594808] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.596040] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.608885] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.610814] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.611822] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.613007] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.614841] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.619835] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.620750] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.622606] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.634808] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.637337] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.640702] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.641549] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.642822] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.646016] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.650907] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.651807] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.652822] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.655021] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.658809] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.659721] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.660614] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.663033] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.666816] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.667739] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.668613] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.671417] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.674756] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.675556] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.676823] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.683221] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.694827] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.696823] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.699861] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.702822] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.708047] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.715840] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.718860] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.725022] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.732850] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.734817] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.736848] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.742291] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.747846] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.748791] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.749626] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.754712] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.755952] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.757936] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.758937] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.759879] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.762878] iommu: Default domain type: Translated375gitlab # [ 0.763803] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.765131] ACPI: bus type USB registered377gitlab # [ 0.765866] usbcore: registered new interface driver usbfs378gitlab # [ 0.766826] usbcore: registered new interface driver hub379gitlab # [ 0.767765] usbcore: registered new device driver usb380gitlab # [ 0.769839] NetLabel: Initializing381gitlab # [ 0.770471] NetLabel: domain hash size = 128382gitlab # [ 0.771801] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.772831] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.773807] PCI: Using ACPI for IRQ routing385gitlab # [ 0.774966] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.775797] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.775797] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.777805] vgaarb: loaded389gitlab # [ 0.778579] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.779801] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.783908] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.788506] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.789263] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.790757] pnp: PnP ACPI init395gitlab # [ 0.791922] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.800775] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.804528] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.807410] NET: Registered PF_INET protocol family399gitlab # [ 0.812428] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.840520] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.842078] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.843524] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.847393] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.848821] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.850433] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.852243] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.853729] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.855052] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.856088] NET: Registered PF_XDP protocol family410gitlab # [ 0.856930] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.857939] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.858946] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.860041] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.861144] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.862475] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.863420] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.865826] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.868447] PCI: CLS 0 bytes, default 64419gitlab # [ 0.869237] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.869985] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.870295] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.870416] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.893504] Initialise system trusted keyrings424gitlab # [ 0.894509] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.905999] Key type asymmetric registered426gitlab # [ 0.906745] Asymmetric key parser 'x509' registered427gitlab # [ 0.907648] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.909179] io scheduler mq-deadline registered429gitlab # [ 0.909972] io scheduler kyber registered430gitlab # [ 0.913815] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.915151] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.917502] Linux agpgart interface v0.103433gitlab # [ 0.918256] ACPI: bus type drm_connector registered434gitlab # [ 0.920857] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.921939] usbserial: USB Serial support registered for generic436gitlab # [ 0.922940] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.922940] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.925177] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.926576] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.927741] NET: Registered PF_INET6 protocol family441gitlab # [ 0.929259] Segment Routing with IPv6442gitlab # [ 0.929943] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.931741] IPI shorthand broadcast: enabled444gitlab # [ 0.936067] sched_clock: Marking stable (787010948, 148453100)->(959525671, -24061623)445gitlab # [ 0.937774] registered taskstats version 1446gitlab # [ 0.938768] Loading compiled-in X.509 certificates447gitlab # [ 0.948858] Demotion targets for Node 0: null448gitlab # [ 0.951245] Key type .fscrypt registered449gitlab # [ 0.953053] Key type fscrypt-provisioning registered450gitlab # [ 0.955598] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 0.957938] ima: Allocated hash algorithm: sha1452gitlab # [ 0.960002] ima: No architecture policies found453gitlab # [ 0.962505] PM: Magic number: 14:634:959454gitlab # [ 0.964510] memory memory10: hash matches455gitlab # [ 0.968173] RAS: Correctable Errors collector initialized.456gitlab # [ 0.981614] clk: Disabling unused clocks457gitlab # [ 0.983511] PM: genpd: Disabling unused power domains458gitlab # [ 1.125029] Freeing initrd memory: 29392K459gitlab # [ 1.132002] Freeing unused decrypted memory: 2028K460gitlab # [ 1.138259] Freeing unused kernel image (initmem) memory: 3640K461gitlab # [ 1.140954] Write protecting the kernel read-only data: 32768k462gitlab # [ 1.145767] Freeing unused kernel image (text/rodata gap) memory: 1220K463gitlab # [ 1.149604] Freeing unused kernel image (rodata/data gap) memory: 760K464gitlab # [ 1.218026] x86/mm: Checked W+X mappings: passed, no W+X pages found.465gitlab # [ 1.219252] Run /init as init process466gitlab # [ 1.231966] systemd[1]: Inserted module 'autofs4'467gitlab # [ 1.254115] fuse: init (API version 7.45)468gitlab # [ 1.262163] ACPI: \_SB_.LNKC: Enabled at IRQ 10469gitlab # [ 1.268806] ACPI: \_SB_.LNKA: Enabled at IRQ 10470gitlab # [ 1.272125] ACPI: \_SB_.LNKB: Enabled at IRQ 11471gitlab # [ 1.307431] systemd[1]: Successfully made /usr/ read-only.472gitlab # [ 1.643227] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)473gitlab # [ 1.659964] systemd[1]: Detected virtualization kvm.474gitlab # [ 1.660890] systemd[1]: Detected architecture x86-64.475gitlab # [ 1.661808] systemd[1]: Running in initrd.476gitlab # [ 1.662888] systemd[1]: Initializing machine ID from random generator.477gitlab # [ 1.664142] systemd[1]: Hostname set to <gitlab>.478gitlab # [ 1.764963] systemd[1]: bpf-restrict-fs: LSM BPF program attached479gitlab # [ 1.827176] systemd[1]: Queued start job for default target Initrd Default Target.480gitlab # [ 1.835071] systemd[1]: Created slice Slice /system/modprobe.481gitlab # [ 1.836282] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.482gitlab # [ 1.837779] systemd[1]: Expecting device /dev/disk/by-label/nix-store...483gitlab # [ 1.839168] systemd[1]: Expecting device /dev/disk/by-label/nixos...484gitlab # [ 1.841363] systemd[1]: Reached target Path Units.485gitlab # [ 1.843136] systemd[1]: Reached target Slice Units.486gitlab # [ 1.844906] systemd[1]: Reached target Swaps.487gitlab # [ 1.846539] systemd[1]: Reached target Timer Units.488gitlab # [ 1.848445] systemd[1]: Listening on D-Bus System Message Bus Socket.489gitlab # [ 1.850350] systemd[1]: Listening on Journal Socket (/dev/log).490gitlab # [ 1.851632] systemd[1]: Listening on Journal Sockets.491gitlab # [ 1.852794] systemd[1]: Listening on udev Control Socket.492gitlab # [ 1.853884] systemd[1]: Listening on udev Kernel Socket.493gitlab # [ 1.854890] systemd[1]: Reached target Socket Units.494gitlab # [ 1.857033] systemd[1]: Starting Create List of Static Device Nodes...495gitlab # [ 1.859085] systemd[1]: Starting Load Kernel Module 9pnet_virtio...496gitlab # [ 1.861174] systemd[1]: Starting Load Kernel Module configfs...497gitlab # [ 1.870553] systemd[1]: Starting Journal Service...498gitlab # [ 1.874669] systemd[1]: Starting Load Kernel Modules...499gitlab # [ 1.875673] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os500gitlab # [ 1.881587] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 1.884745] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 1.889156] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 1.891283] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 1.892807] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 1.900567] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 1.908848] systemd-journald[92]: Collecting audit messages is disabled.507gitlab # [ 1.915026] netfs: FS-Cache loaded508gitlab # [ 1.918076] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.509gitlab # [ 1.921650] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev510gitlab # [ 1.924321] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.511gitlab # [ 1.929070] systemd[1]: Starting Create Static Device Nodes in /dev...512gitlab # [ 1.931275] 9pnet: Installing 9P2000 support513gitlab # [ 1.935563] systemd[1]: Finished Load Kernel Modules.514gitlab # [ 1.937019] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 1.938768] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 1.941017] systemd[1]: Starting Apply Kernel Variables...517gitlab # [ 1.942787] systemd[1]: Finished Create Static Device Nodes in /dev.518gitlab # [ 1.944239] systemd[1]: Reached target Preparation for Local File Systems.519gitlab # [ 1.945544] systemd[1]: Reached target Local File Systems.520gitlab # [ 1.809253] systemd-modules-load[93]: Using 4 probe threads521gitlab # [ 1.810586] systemd-modules-load[93]: Inserted module 'virtio_balloon'522gitlab # [ 1.959865] systemd[1]: Starting Rule-based Manager for Device Events and Files...523gitlab # [ 1.812827] systemd-modules-load[93]: Inserted module 'dm_mod'524gitlab # [ 1.961927] systemd[1]: Started Journal Service.525gitlab # [ 1.814610] systemd-modules-load[93]: Inserted module 'virtio_gpu'526gitlab # [ 1.817835] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 1.821048] systemd[1]: Starting Create System Files and Directories...528gitlab # [ 1.828763] systemd-udevd[105]: Using default interface naming scheme 'v261'.529gitlab # [ 1.834720] systemd[1]: Finished Create System Files and Directories.530gitlab # [ 1.841034] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 1.855319] systemd[1]: Finished Coldplug All udev Devices.532gitlab # [ 1.856138] systemd[1]: Reached target System Initialization.533gitlab # [ 1.856970] systemd[1]: Reached target Basic System.534gitlab # [ 2.106324] virtio_blk virtio4: 4/0/0 default/read/poll queues535gitlab # [ 2.110662] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)536gitlab # [ 2.116081] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12537gitlab # [ 2.117396] SCSI subsystem initialized538gitlab # [ 2.123762] serio: i8042 KBD port at 0x60,0x64 irq 1539gitlab # [ 2.124503] serio: i8042 AUX port at 0x60,0x64 irq 12540gitlab # [ 2.125472] uhci_hcd 0000:00:01.2: UHCI Host Controller541gitlab # [ 2.125544] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1542gitlab # [ 2.129224] uhci_hcd 0000:00:01.2: detected 2 ports543gitlab # [ 2.131634] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140544gitlab # [ 2.132791] virtio_blk virtio5: 4/0/0 default/read/poll queues545gitlab # [ 2.132896] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18546gitlab # [ 2.134933] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1547gitlab # [ 2.136107] usb usb1: Product: UHCI Host Controller548gitlab # [ 2.137297] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd549gitlab # [ 2.138258] usb usb1: SerialNumber: 0000:00:01.2550gitlab # [ 2.146019] hub 1-0:1.0: USB hub found551gitlab # [ 2.146727] hub 1-0:1.0: 2 ports detected552gitlab # [ 2.149786] virtio_blk virtio5: [vdb] 11953240 512-byte logical blocks (6.12 GB/5.70 GiB)553gitlab # [ 2.157978] scsi host0: ata_piix554gitlab # [ 2.158834] scsi host1: ata_piix555gitlab # [ 2.159399] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0556gitlab # [ 2.160520] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0557gitlab # [ 2.026593] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.028199] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.033234] (udev-worker)[136]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.560gitlab # [ 2.037082] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.561gitlab # [ 2.046761] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.048394] systemd[1]: Found device /dev/disk/by-label/nixos.563gitlab # [ 2.049665] systemd[1]: Found device /dev/disk/by-label/nix-store.564gitlab # [ 2.050704] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 2.051569] systemd[1]: Reached target Initrd Root Device.566gitlab # [ 2.052432] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...567gitlab # [ 2.089447] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.093757] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.315607] ata2: found unknown device (class 0)570gitlab # [ 2.316917] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.319194] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.341890] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.373537] usb 1-1: new full-speed USB device number 2 using uhci_hcd574gitlab # [ 2.377666] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray575gitlab # [ 2.409134] cdrom: Uniform CD-ROM driver Revision: 3.20576gitlab # [ 2.544663] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00577gitlab # [ 2.547719] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10578gitlab # [ 2.550481] usb 1-1: Product: QEMU USB Tablet579gitlab # [ 2.552158] usb 1-1: Manufacturer: QEMU580gitlab # [ 2.553667] usb 1-1: SerialNumber: 28754-0000:00:01.2-1581gitlab # [ 2.586081] hid: raw HID events driver (C) Jiri Kosina582gitlab # [ 2.599266] usbcore: registered new interface driver usbhid583gitlab # [ 2.601394] usbhid: USB HID core driver584gitlab # [ 2.610368] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2585gitlab # [ 2.613610] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0586gitlab # [ 2.738904] systemd[1]: Mounting /sysroot...587gitlab # [ 3.011728] EXT4-fs (vda): mounted filesystem 33394315-53ad-4134-a0e4-501d8d833ce7 r/w with ordered data mode. Quota mode: none.588gitlab # [ 2.869543] systemd[1]: Mounted /sysroot.589gitlab # [ 2.871351] systemd[1]: Reached target Initrd Root File System.590gitlab # [ 2.873479] systemd[1]: Mounting /sysroot/nix/.ro-store...591gitlab # [ 2.875443] systemd[1]: Mounting /sysroot/nix/.rw-store...592gitlab # [ 2.877432] systemd[1]: Mounting /sysroot/run...593gitlab # [ 2.879214] systemd[1]: Mounting /sysroot/tmp/shared...594gitlab # [ 2.892195] systemd[1]: Mounting /sysroot/tmp/xchg...595gitlab # [ 2.897740] systemd[1]: Starting Mountpoints Configured in the Real Root...596gitlab # [ 2.903502] systemd[1]: Mounted /sysroot/run.597gitlab # [ 2.911026] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.598gitlab # [ 2.915269] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...599gitlab # [ 2.918438] systemd[1]: Reloading...600gitlab # [ 3.068316] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.069685] 9p: Installing v9fs 9p2000 file system support602gitlab # [ 2.982409] systemd[1]: Reloading finished in 65 ms.603gitlab # [ 3.004865] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...604gitlab # [ 3.007181] systemd[1]: Mounted /sysroot/nix/.ro-store.605gitlab # [ 3.008558] systemd[1]: Mounted /sysroot/nix/.rw-store.606gitlab # [ 3.009915] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.012171] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.013548] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...609gitlab # [ 3.015683] systemd[1]: Starting rw-sysroot-nix-store.service...610gitlab # [ 3.017306] systemd[1]: initrd-parse-etc.service: Deactivated successfully.611gitlab # [ 3.019164] systemd[1]: Finished Mountpoints Configured in the Real Root.612gitlab # [ 3.020988] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.613gitlab # [ 3.029858] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614gitlab # [ 3.031873] systemd[1]: Finished rw-sysroot-nix-store.service.615gitlab # [ 3.739395] systemd[1]: Mounting /sysroot/nix/store...616gitlab # [ 3.785665] systemd[1]: Mounted /sysroot/nix/store.617gitlab # [ 3.787439] systemd[1]: Reached target Initrd File Systems.618gitlab # [ 3.789421] systemd[1]: Starting Find NixOS closure...619gitlab # [ 3.791219] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...620gitlab # [ 3.802070] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.621gitlab # [ 3.806144] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.622gitlab # [ 3.818280] systemd[1]: Finished Find NixOS closure.623gitlab # [ 3.820874] systemd[1]: Reached target Initrd Default Target.624gitlab # [ 3.822834] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...625gitlab # [ 3.850814] systemd[1]: Stopped target Initrd Default Target.626gitlab # [ 3.852528] systemd[1]: Stopped target Basic System.627gitlab # [ 3.854268] systemd[1]: Stopped target Initrd Root Device.628gitlab # [ 3.856128] systemd[1]: Stopped target Path Units.629gitlab # [ 3.857841] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.630gitlab # [ 3.860295] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.631gitlab # [ 3.862777] systemd[1]: Stopped target Slice Units.632gitlab # [ 3.864871] systemd[1]: Stopped target Socket Units.633gitlab # [ 3.867197] systemd[1]: Stopped target System Initialization.634gitlab # [ 3.869490] systemd[1]: Stopped target Swaps.635gitlab # [ 3.872522] systemd[1]: Stopped target Timer Units.636gitlab # [ 3.874415] systemd[1]: dbus.socket: Deactivated successfully.637gitlab # [ 3.876560] systemd[1]: Closed D-Bus System Message Bus Socket.638gitlab # [ 3.878401] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.639gitlab # [ 3.880695] systemd[1]: Stopped Find NixOS closure.640gitlab # [ 3.882306] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio641gitlab # [ 3.885140] systemd[1]: Starting rw-sysroot-nix-store.service...642gitlab # [ 3.886744] systemd[1]: systemd-sysctl.service: Deactivated successfully.643gitlab # [ 3.888544] systemd[1]: Stopped Apply Kernel Variables.644gitlab # [ 3.889942] systemd[1]: systemd-modules-load.service: Deactivated successfully.645gitlab # [ 3.891828] systemd[1]: Stopped Load Kernel Modules.646gitlab # [ 3.893232] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.647gitlab # [ 3.895243] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.648gitlab # [ 3.897234] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.649gitlab # [ 3.898888] systemd[1]: Stopped Create System Files and Directories.650gitlab # [ 3.900270] systemd[1]: Stopped target Local File Systems.651gitlab # [ 3.901455] systemd[1]: Stopped target Preparation for Local File Systems.652gitlab # [ 3.902943] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.653gitlab # [ 3.903991] systemd[1]: Stopped Coldplug All udev Devices.654gitlab # [ 3.904783] systemd[1]: Stopping Rule-based Manager for Device Events and Files...655gitlab # [ 3.905858] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.656gitlab # [ 3.906904] systemd[1]: Stopped Virtual Console Setup.657gitlab # [ 3.907638] systemd[1]: initrd-cleanup.service: Deactivated successfully.658gitlab # [ 3.908603] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.659gitlab # [ 3.909646] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.660gitlab # [ 3.910633] systemd[1]: Finished rw-sysroot-nix-store.service.661gitlab # [ 3.911462] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 3.912390] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 3.913369] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.664gitlab # [ 3.914352] systemd[1]: Closed udev Control Socket.665gitlab # [ 3.915063] systemd[1]: Starting Cleanup udev Database...666gitlab # [ 3.915867] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.667gitlab # [ 3.916915] systemd[1]: Stopped Create Static Device Nodes in /dev.668gitlab # [ 3.917758] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.669gitlab # [ 3.918864] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.670gitlab # [ 3.919843] systemd[1]: kmod-static-nodes.service: Deactivated successfully.671gitlab # [ 3.920787] systemd[1]: Stopped Create List of Static Device Nodes.672gitlab # [ 3.923493] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.673gitlab # [ 3.924536] systemd[1]: Finished Cleanup udev Database.674gitlab # [ 3.925327] systemd[1]: Reached target Switch Root.675gitlab # [ 3.926038] systemd[1]: Starting NixOS Activation...676gitlab # [ 4.007861] initrd-nixos-activation-start[228]: booting system configuration /nix/store/2sis0k3zpkzj06k8whp92qdrr92n20j2-nixos-system-gitlab-test677gitlab # [ 4.036043] initrd-nixos-activation-start[228]: running activation script...678gitlab # [ 4.191699] initrd-nixos-activation-start[251]: setting up /etc...679gitlab # [ 4.267146] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.680gitlab # [ 4.269428] systemd[1]: Finished NixOS Activation.681gitlab # [ 4.270717] systemd[1]: Starting Switch Root...682gitlab # [ 4.287825] systemd[1]: Switching root.683gitlab # [ 4.501357] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).684gitlab # [ 4.602704] NET: Registered PF_VSOCK protocol family685gitlab # [ 4.974545] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)686gitlab # [ 4.984739] systemd[1]: Detected virtualization kvm.687gitlab # [ 4.986583] systemd[1]: Detected architecture x86-64.688gitlab # [ 4.988601] systemd[1]: Detected first boot.689gitlab # [ 4.991132] systemd[1]: Initializing machine ID from random generator.690gitlab # [ 5.128185] systemd[1]: bpf-restrict-fs: LSM BPF program attached691gitlab # [ 5.211214] systemd[1]: Applying preset policy.692gitlab # [ 5.318059] systemd[1]: Populated /etc with preset unit settings.693gitlab # [ 5.422900] systemd[1]: initrd-switch-root.service: Deactivated successfully.694gitlab # [ 5.424243] systemd[1]: Stopped initrd-switch-root.service.695gitlab # [ 5.426482] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.696gitlab # [ 5.428613] systemd[1]: Created slice Slice /system/getty.697gitlab # [ 5.430143] systemd[1]: Created slice GitLab DevOps Platform Slice.698gitlab # [ 5.431606] systemd[1]: Created slice User and Session Slice.699gitlab # [ 5.432552] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.700gitlab # [ 5.433883] systemd[1]: Started Forward Password Requests to Wall Directory Watch.701gitlab # [ 5.435025] systemd[1]: Expecting device /dev/hvc0...702gitlab # [ 5.435873] systemd[1]: Expecting device /dev/ttyS0...703gitlab # [ 5.436662] systemd[1]: Reached target Local Encrypted Volumes.704gitlab # [ 5.437543] systemd[1]: Stopped target initrd-fs.target.705gitlab # [ 5.438287] systemd[1]: Stopped target initrd-root-fs.target.706gitlab # [ 5.439148] systemd[1]: Stopped target initrd-switch-root.target.707gitlab # [ 5.440126] systemd[1]: Reached target Virtual Machines and Containers.708gitlab # [ 5.441169] systemd[1]: Reached target Path Units.709gitlab # [ 5.441993] systemd[1]: Reached target Remote File Systems.710gitlab # [ 5.442849] systemd[1]: Reached target Slice Units.711gitlab # [ 5.443675] systemd[1]: Reached target Swaps.712gitlab # [ 5.445076] systemd[1]: Listening on Query the User Interactively for a Password.713gitlab # [ 5.447146] systemd[1]: Listening on Process Core Dump Socket.714gitlab # [ 5.448607] systemd[1]: Listening on Credential Encryption/Decryption.715gitlab # [ 5.450184] systemd[1]: Listening on Factory Reset Management.716gitlab # [ 5.451216] systemd[1]: Listening on Hostname Service Socket.717gitlab # [ 5.453587] systemd[1]: Starting Journal Log Access Socket...718gitlab # [ 5.454949] systemd[1]: Listening on Journal Audit Socket.719gitlab # [ 5.456968] systemd[1]: Listening on Console Output Muting Service Socket.720gitlab # [ 5.458242] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.721gitlab # [ 5.459428] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os722gitlab # [ 5.460935] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki723gitlab # [ 5.463654] systemd[1]: Listening on Disk Repartitioning Service Socket.724gitlab # [ 5.464737] systemd[1]: Listening on udev Control Socket.725gitlab # [ 5.465661] systemd[1]: Listening on udev Varlink Socket.726gitlab # [ 5.468236] systemd[1]: Mounting Huge Pages File System...727gitlab # [ 5.470203] systemd[1]: Mounting POSIX Message Queue File System...728gitlab # [ 5.472292] systemd[1]: Mounting Kernel Debug File System...729gitlab # [ 5.475524] systemd[1]: Mounting Kernel Trace File System...730gitlab # [ 5.485809] systemd[1]: Starting Create List of Static Device Nodes...731gitlab # [ 5.486919] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio732gitlab # [ 5.490958] systemd[1]: Starting Load Kernel Module configfs...733gitlab # [ 5.524771] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm734gitlab # [ 5.528618] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore735gitlab # [ 5.532703] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse736gitlab # [ 5.538185] systemd[1]: Mounting FUSE Control File System...737gitlab # [ 5.539993] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67738gitlab # [ 5.547864] systemd[1]: Starting Journal Service...739gitlab # [ 5.551520] systemd[1]: Starting Load Kernel Modules...740gitlab # [ 5.560304] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...741gitlab # [ 5.562346] systemd[1]: Starting Remount Root and Kernel File Systems...742gitlab # [ 5.563454] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os743gitlab # [ 5.568630] systemd[1]: Starting Coldplug All udev Devices...744gitlab # [ 5.578687] loop: module loaded745gitlab # [ 5.580562] EXT4-fs (vda): re-mounted 33394315-53ad-4134-a0e4-501d8d833ce7.746gitlab # [ 5.580718] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 5.581336] systemd-journald[321]: Collecting audit messages is enabled.748gitlab # [ 5.583020] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 5.585343] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 5.586405] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 5.587359] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 5.588664] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 5.589881] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 5.591366] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 5.592482] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 5.593794] systemd[1]: Finished Load Kernel Modules.757gitlab # [ 5.595261] systemd[1]: Finished Remount Root and Kernel File Systems.758gitlab # [ 5.596764] systemd[1]: Listening on Disk Image Download Service Socket.759gitlab # [ 5.599661] systemd[1]: Mounting Kernel Configuration File System...760gitlab # [ 5.453799] systemd[1]: Queued start job for default target Multi-User System.761gitlab # [ 5.455182] systemd[1]: Unnecessary job was removed for /dev/vdb.762gitlab # [ 5.456323] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 5.605683] systemd[1]: Starting Firewall...764gitlab # [ 5.606357] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore765gitlab # [ 5.458383] systemd-modules-load[322]: Using 3 probe threads766gitlab # [ 5.460840] systemd-modules-load[322]: Inserted module 'loop'767gitlab # [ 5.461935] systemd-modules-load[322]: Inserted module 'tls'768gitlab # [ 5.463165] systemd-oomd[324]: No swap; memory pressure usage will be degraded769gitlab # [ 5.616201] systemd[1]: Starting Load/Save OS Random Seed...770gitlab # [ 5.619344] systemd[1]: Starting Apply Kernel Variables...771gitlab # [ 5.622472] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...772gitlab # [ 5.623841] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 5.627004] systemd[1]: Started Journal Service.774gitlab # [ 5.479888] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.775gitlab # [ 5.481871] systemd[1]: Mounted Kernel Configuration File System.776gitlab # [ 5.484431] systemd[1]: Finished Load/Save OS Random Seed.777gitlab # [ 5.485835] systemd[1]: Reached target First Boot Complete.778gitlab # [ 5.487991] systemd[1]: Starting Flush Journal to Persistent Storage...779gitlab # [ 5.490596] systemd[1]: Finished Apply Kernel Variables.780gitlab # [ 5.496068] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 5.501087] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 5.654026] systemd-journald[321]: Received client request to flush runtime journal.783gitlab # [ 5.543910] systemd[1]: Finished Create Static Device Nodes in /dev.784gitlab # [ 5.545239] systemd[1]: Reached target Preparation for Local File Systems.785gitlab # [ 5.546269] systemd[1]: Starting Rule-based Manager for Device Events and Files...786gitlab # [ 5.547591] systemd-udevd[360]: Using default interface naming scheme 'v261'.787gitlab # [ 5.550135] systemd[1]: Finished Flush Journal to Persistent Storage.788gitlab # [ 5.568945] systemd[1]: Started Rule-based Manager for Device Events and Files.789gitlab # [ 5.570119] systemd[1]: Finished Coldplug All udev Devices.790gitlab # [ 5.643561] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse791gitlab # [ 5.664478] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.792gitlab # [ 5.674818] (udev-worker)[431]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.793gitlab # [ 5.684391] (udev-worker)[431]: Network interface NamePolicy= disabled on kernel command line.794gitlab # [ 5.686784] (udev-worker)[445]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.688692] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 5.691043] systemd[1]: Condition check resulted in Virtio network device being skipped.797gitlab # [ 5.692287] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore798gitlab # [ 5.693910] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67799gitlab # [ 5.696148] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore800gitlab # [ 5.699179] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os801gitlab # [ 5.701148] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os802gitlab # [ 5.702484] systemd[1]: Finished Firewall.803gitlab # [ 5.874570] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3804gitlab # [ 5.882565] ACPI: button: Power Button [PWRF]805gitlab # [ 5.891167] mousedev: PS/2 mouse device common for all mice806gitlab # [ 5.894241] rtc_cmos 00:05: RTC can wake from S4807gitlab # [ 5.895782] rtc_cmos 00:05: registered as rtc0808gitlab # [ 5.896611] rtc_cmos 00:05: setting system clock to 2026-10-17T23:56:29 UTC (1792281389)809gitlab # [ 5.898309] parport_pc 00:03: reported by Plug and Play ACPI810gitlab # [ 5.898317] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs811gitlab # [ 5.898672] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]812gitlab # [ 5.901607] Floppy drive(s): fd0 is 2.88M AMI BIOS813gitlab # [ 5.902839] systemd-journald[321]: Time jumped backwards, rotating.814gitlab # [ 5.915181] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console815gitlab # [ 5.919392] FDC 0 is a S82078B816gitlab # [ 5.931461] Console: switching to colour dummy device 80x25817gitlab # [ 5.932675] [drm] Found bochs VGA, ID 0xb0c5.818gitlab # [ 5.933121] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.819gitlab # [ 5.935256] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0820gitlab # [ 5.936136] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD821gitlab # [ 5.941624] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic822gitlab # [ 5.942354] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0823gitlab # [ 5.949794] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4824gitlab # [ 5.957858] Console: switching to colour frame buffer device 160x50825gitlab # [ 5.959466] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device826gitlab # [ 5.976569] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6827gitlab # [ 5.998700] ppdev: user-space parallel port driver828gitlab # [ 6.001226] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 5.853796] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 5.877782] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 5.886464] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 5.905660] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 5.910657] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.834gitlab # [ 5.911672] systemd[1]: Stopped Virtual Console Setup.835gitlab # [ 5.923373] systemd[1]: Starting Virtual Console Setup...836gitlab # [ 6.114030] kvm_amd: TSC scaling supported837gitlab # [ 6.114650] kvm_amd: Nested Virtualization enabled838gitlab # [ 6.115234] kvm_amd: Nested Paging enabled839gitlab # [ 6.115771] kvm_amd: LBR virtualization supported840gitlab # [ 6.116345] kvm_amd: Virtual VMLOAD VMSAVE supported841gitlab # [ 6.117025] kvm_amd: Virtual GIF supported842gitlab # [ 6.117613] kvm_amd: Virtual NMI enabled843gitlab # [ 6.147867] EDAC MC: Ver: 3.0.0844gitlab # [ 6.014545] systemd-vconsole-setup[496]: Configuration of first virtual console was skipped, ignoring remaining ones.845gitlab # [ 6.016906] systemd[1]: Finished Virtual Console Setup.846gitlab # [ 6.279202] systemd[1]: Mounting /run/wrappers...847gitlab # [ 6.305779] systemd[1]: Mounted /run/wrappers.848gitlab # [ 6.307715] systemd[1]: Reached target Local File Systems.849gitlab # [ 6.309584] systemd[1]: Listening on Boot Loader Control Service Socket.850gitlab # [ 6.312214] systemd[1]: Starting register-nix-paths.service...851gitlab # [ 6.314439] systemd[1]: Starting Create SUID/SGID Wrappers...852gitlab # [ 6.316455] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.853gitlab # [ 6.319333] systemd[1]: Starting Save Transient machine-id to Disk...854gitlab # [ 6.321445] systemd[1]: Starting Create System Files and Directories...855gitlab # [ 6.350978] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.856gitlab # [ 6.353620] systemd[1]: Finished Save Transient machine-id to Disk.857gitlab # [ 6.370102] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 6.377373] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 6.380639] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 6.403570] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 6.416937] systemd[1]: Finished Rebuild Journal Catalog.862gitlab # [ 6.419070] systemd[1]: Starting Update is Completed...863gitlab # [ 6.438729] systemd[1]: Finished Update is Completed.864gitlab # [ 6.462734] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.865gitlab # [ 6.464953] systemd[1]: Finished Create SUID/SGID Wrappers.866gitlab # [ 6.657736] systemd[1]: Finished register-nix-paths.service.867gitlab # [ 6.659962] systemd[1]: Reached target System Initialization.868gitlab # [ 6.662114] systemd[1]: Started Discard unused filesystem blocks once a week.869gitlab # [ 6.664703] systemd[1]: Started logrotate.timer.870gitlab # [ 6.666576] systemd[1]: Started Daily Cleanup of Temporary Directories.871gitlab # [ 6.668969] systemd[1]: Reached target Timer Units.872gitlab # [ 6.670846] systemd[1]: Listening on D-Bus System Message Bus Socket.873gitlab # [ 6.673179] systemd[1]: Listening on Nix Daemon Socket.874gitlab # [ 6.675084] systemd[1]: Starting nixbot CI service socket...875gitlab # [ 6.677109] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.876gitlab # [ 6.679946] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 6.682127] systemd[1]: Reached target Socket Units.878gitlab # [ 6.684102] systemd[1]: Starting D-Bus System Message Bus...879gitlab # [ 6.728195] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...880gitlab # [ 6.731445] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'881gitlab # [ 6.734192] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"882gitlab # [ 6.739158] systemd[1]: Started D-Bus System Message Bus.883gitlab # [ 6.756413] dbus-broker-launch[578]: Ready884gitlab # [ 6.758345] systemd[1]: Reached target Basic System.885gitlab # [ 6.760322] systemd[1]: Started backdoor.service.886gitlab # [ 6.762307] systemd[1]: Starting gitlab-config.service...887gitlab # [ 6.764230] systemd[1]: Starting Import lastlog data into lastlog2 database...888gitlab # [ 6.768173] systemd[1]: Starting Logrotate configuration check...889gitlab # [ 6.777566] systemd[1]: Starting Name Service Cache Daemon (nsncd)...890gitlab # [ 6.781439] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.891gitlab # [ 6.791465] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf892gitlab # [ 6.794079] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'893gitlab # [ 6.796138] logrotate[583]: Reading state from file: /var/lib/logrotate.status894gitlab # [ 6.798040] logrotate[583]: state file /var/lib/logrotate.status does not exist895gitlab # [ 6.802139] logrotate[583]: Allocating hash table for state file, size 64 entries896gitlab # [ 6.804315] logrotate[583]: Handling 4 logs897gitlab # [ 6.805545] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed898gitlab # connecting to host...899gitlab # [ 6.809500] logrotate[583]: considering log /var/log/btmp900gitlab # [ 6.810449] logrotate[583]: Creating new state901gitlab # [ 6.811368] logrotate[583]: Now: 2026-10-17 23:56902gitlab # [ 6.811969] logrotate[583]: Last rotated at 2026-10-17 23:00903gitlab # [ 6.812623] logrotate[583]: log does not need rotating (log has already been rotated)904gitlab # [ 6.813165] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed905gitlab # [ 6.813636] logrotate[583]: considering log /var/log/wtmp906gitlab # [ 6.814097] logrotate[583]: Creating new state907gitlab # [ 6.814553] logrotate[583]: Now: 2026-10-17 23:56908gitlab # [ 6.815036] logrotate[583]: Last rotated at 2026-10-17 23:00909gitlab # [ 6.815464] logrotate[583]: log does not need rotating (log has already been rotated)910gitlab # [ 6.815936] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed911gitlab # [ 6.816567] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)912gitlab # [ 6.817046] logrotate[583]: considering log /var/gitlab/state/log/*.log913gitlab # [ 6.817494] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping914gitlab # [ 6.817967] logrotate[583]: Creating new state915gitlab # [ 6.818581] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)916gitlab # [ 6.819082] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed917gitlab # [ 6.819551] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)918gitlab # [ 6.820033] logrotate[583]: considering log /var/log/nginx/*.log919gitlab # [ 6.820465] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping920gitlab # [ 6.820920] logrotate[583]: Creating new state921gitlab # [ 6.821400] logrotate[583]: not running postrotate script, since no logs were rotated922gitlab # [ 6.821857] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)923gitlab # [ 6.822428] systemd[1]: Starting Post-Boot Actions...924gitlab # [ 6.822976] systemd[1]: Started Reset console on configuration changes.925gitlab # [ 6.823594] systemd[1]: Starting resolvconf update...926gitlab # [ 6.824272] systemd[1]: Finished Logrotate configuration check.927gitlab # [ 6.834642] systemd[1]: Finished Post-Boot Actions.928gitlab # [ 6.838864] systemd[1]: Finished Import lastlog data into lastlog2 database.929gitlab: Guest shell says: b'Spawning backdoor root shell...\n'930gitlab # [ 6.849561] nsncd[584]: Oct 17 23:56:30.601 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"931gitlab: connected to guest root shell932gitlab # [ 6.850205] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab: (connecting took 7.45 seconds)934gitlab # [ 6.850737] systemd[1]: Reached target Host and Network Name Lookups.935gitlab: (finished: waiting for the VM to finish booting, in 7.45 seconds)936gitlab # [ 6.851179] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 6.853745] systemd[1]: Starting User Login Management...938gitlab # [ 6.874898] systemd[1]: Stopped target Host and Network Name Lookups.939gitlab # [ 6.875580] systemd[1]: Stopping Host and Network Name Lookups...940gitlab # [ 6.880119] systemd[1]: Stopped target User and Group Name Lookups.941gitlab # [ 6.880803] systemd[1]: Stopping User and Group Name Lookups...942gitlab # [ 6.881640] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...943gitlab # [ 6.882622] systemd[1]: nscd.service: Deactivated successfully.944gitlab # [ 6.884132] systemd[1]: Stopped Name Service Cache Daemon (nsncd).945gitlab # [ 6.885028] systemd[1]: nscd.service: Consumed 19ms CPU time over 100ms wall clock time, 7.3M memory peak, 5.5M read from disk.946gitlab # [ 6.887616] systemd[1]: Starting Name Service Cache Daemon (nsncd)...947gitlab # [ 6.895189] systemd-logind[632]: New seat seat0.948gitlab # [ 6.900900] systemd-logind[632]: Watching system buttons on /dev/input/event2 (Power Button)949gitlab # [ 6.901619] systemd-logind[632]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)950gitlab # [ 6.902469] systemd-logind[632]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)951gitlab # [ 6.902958] systemd[1]: Started User Login Management.952gitlab # [ 6.907802] systemd[1]: Starting linger-users.service...953gitlab # [ 6.909127] nsncd[672]: Oct 17 23:56:30.655 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"954gitlab # [ 6.911223] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 6.912186] systemd[1]: Reached target Host and Network Name Lookups.956gitlab # [ 6.913515] systemd[1]: Reached target User and Group Name Lookups.957gitlab # [ 6.919091] systemd[1]: Finished resolvconf update.958gitlab # [ 6.919759] systemd[1]: linger-users.service: Deactivated successfully.959gitlab # [ 6.920605] systemd[1]: Finished linger-users.service.960gitlab # [ 6.921585] systemd[1]: Reached target Preparation for Network.961gitlab # [ 6.924551] systemd[1]: Starting DHCP Client...962gitlab # [ 6.926078] systemd[1]: Starting Address configuration of eth1...963gitlab # [ 6.928681] systemd[1]: Starting Extra networking commands....964gitlab # [ 6.954080] network-addresses-eth1-start[701]: adding address 192.168.1.1/24... done965gitlab # [ 6.957299] network-addresses-eth1-start[701]: adding address 2001:db8:1::1/64... done966gitlab # [ 6.962031] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 6.987264] systemd[1]: Finished Extra networking commands..968gitlab # [ 6.988923] systemd[1]: Reached target Network.969gitlab # [ 6.990352] systemd[1]: Starting gitlab-workhorse.service...970gitlab # [ 6.991216] dhcpcd[709]: dhcpcd-10.3.2 starting971gitlab # [ 6.993024] systemd[1]: Starting Nginx Web Server...972gitlab # [ 6.993848] dhcpcd[767]: dev: loaded udev973gitlab # [ 6.996405] systemd[1]: Starting PostgreSQL Server...974gitlab # [ 7.148457] 8021q: 802.1Q VLAN Support v1.8975gitlab # [ 7.000422] systemd[1]: Starting Redis Server - redis-gitlab...976gitlab # [ 7.148938] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.003257] systemd[1]: Starting Permit User Sessions...978gitlab # [ 7.019086] systemd[1]: Finished Permit User Sessions.979gitlab # [ 7.024294] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.980gitlab # [ 7.028426] systemd[1]: Started Getty on tty1.981gitlab # [ 7.029087] systemd[1]: Reached target Login Prompts.982gitlab # [ 7.242781] cfg80211: Loading compiled-in X.509 certificates for regulatory database983gitlab # [ 7.247237] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984gitlab # [ 7.248041] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985gitlab # [ 7.249241] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986gitlab # [ 7.250185] cfg80211: failed to load regulatory.db987gitlab # [ 7.113251] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok988gitlab # [ 7.114895] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful989gitlab # [ 7.120406] systemd[1]: Started Nginx Web Server.990gitlab # [ 7.280582] 8021q: adding VLAN 0 to HW filter on device eth0991gitlab # [ 7.133718] dhcpcd[767]: eth0: waiting for carrier992gitlab # [ 7.135265] dhcpcd[767]: eth0: carrier acquired993gitlab # [ 7.137448] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".994gitlab # [ 7.138021] postgresql-pre-start[792]: This user must also own the server process.995gitlab # [ 7.139525] dhcpcd[767]: DUID 00:01:00:01:32:66:c7:ae:52:54:00:12:34:56996gitlab # [ 7.140418] dhcpcd[767]: eth0: IAID 00:12:34:56997gitlab # [ 7.141068] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456998gitlab # [ 7.144570] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".999gitlab # [ 7.145243] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".1000gitlab # [ 7.145746] postgresql-pre-start[792]: The default text search configuration will be set to "english".1001gitlab # [ 7.146395] postgresql-pre-start[792]: Data page checksums are enabled.1002gitlab # [ 7.149051] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1003gitlab # [ 7.149746] postgresql-pre-start[792]: creating subdirectories ... ok1004gitlab # [ 7.150426] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix1005gitlab # [ 7.151308] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1006gitlab # [ 7.151770] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1007gitlab # [ 7.152230] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started1008gitlab # [ 7.152712] redis-server[791]: Configuration loaded1009gitlab # [ 7.153161] redis[791]: monotonic clock: POSIX clock_gettime1010gitlab # [ 7.155992] redis[791]: Running mode=standalone, port=0.1011gitlab # [ 7.156841] systemd[1]: Started Redis Server - redis-gitlab.1012gitlab # [ 7.157541] redis[791]: Server initialized1013gitlab # [ 7.158159] redis[791]: Ready to accept connections unix1014gitlab # [ 7.158269] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1015gitlab # [ 7.189410] postgresql-pre-start[792]: selecting default "max_connections" ... 1001016gitlab # [ 7.232508] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB1017gitlab # [ 7.433350] systemd[1]: Started gitlab-workhorse.service.1018gitlab # [ 7.587735] gitlab-workhorse[826]: time="2026-10-17T23:56:31Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41019gitlab # [ 7.589702] gitlab-workhorse[826]: time="2026-10-17T23:56:31Z" level=info msg="Using redis/go-redis"1020gitlab # [ 7.591126] gitlab-workhorse[826]: time="2026-10-17T23:56:31Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1021gitlab # [ 7.625102] postgresql-pre-start[792]: selecting default time zone ... UTC1022gitlab # [ 7.627229] postgresql-pre-start[792]: creating configuration files ... ok1023gitlab # [ 7.780090] postgresql-pre-start[792]: running bootstrap script ... ok1024gitlab # [ 8.209995] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok1025gitlab # [ 8.433567] postgresql-pre-start[792]: syncing data to disk ... ok1026gitlab # [ 8.434495] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections1027gitlab # [ 8.435025] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1028gitlab # [ 8.435552] postgresql-pre-start[792]: Success. You can now start the database server using:1029gitlab # [ 8.436058] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1030gitlab # [ 8.508374] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1031gitlab # [ 8.509736] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321032gitlab # [ 8.510563] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321033gitlab # [ 8.516683] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1034gitlab # [ 8.529901] postgres[860]: [860] LOG: database system was shut down at 2026-10-17 23:56:31 GMT1035gitlab # [ 8.543153] postgres[850]: [850] LOG: database system is ready to accept connections1036gitlab # [ 8.547635] systemd[1]: Started PostgreSQL Server.1037gitlab # [ 8.552205] systemd[1]: Starting PostgreSQL Setup Scripts...1038gitlab # [ 8.622331] dhcpcd[767]: eth0: soliciting an IPv6 router1039gitlab # [ 8.623389] dhcpcd[767]: eth0: Router Advertisement from fe80::21040gitlab # [ 8.624468] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/641041gitlab # [ 8.625406] dhcpcd[767]: eth0: adding route to fec0::/641042gitlab # [ 8.626610] dhcpcd[767]: eth0: adding default route via fe80::21043gitlab # [ 8.681400] dhcpcd[767]: eth0: soliciting a DHCP lease1044gitlab # [ 8.839752] NET: Registered PF_PACKET protocol family1045gitlab # [ 8.699384] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.21046gitlab # [ 8.704322] dhcpcd[767]: eth0: probing address 10.0.2.15/241047gitlab # [ 8.751764] postgresql-setup-start[871]: CREATE DATABASE1048gitlab # [ 8.777247] postgresql-setup-start[883]: CREATE ROLE1049gitlab # [ 8.786761] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[876]: mkdir -p /var/gitlab/state/home/.ssh: OK1050gitlab # [ 8.787940] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[876]: chmod 700 /var/gitlab/state/home/.ssh: OK1051gitlab # [ 8.789871] postgresql-setup-start[885]: ALTER DATABASE1052gitlab # [ 8.812970] postgresql-setup-start[897]: CREATE ROLE1053gitlab # [ 8.815391] systemd[1]: Finished PostgreSQL Setup Scripts.1054gitlab # [ 8.817121] systemd[1]: Reached target PostgreSQL.1055gitlab # [ 8.819483] systemd[1]: Starting gitlab-postgresql.service...1056gitlab # [ 8.828301] systemd[1]: Finished gitlab-config.service.1057gitlab # [ 8.830105] systemd[1]: Started gitaly.service.1058gitlab # [ 8.831713] systemd[1]: Starting gitlab-db-config.service...1059gitlab # [ 8.897883] gitlab-postgresql-start[913]: CREATE DATABASE1060gitlab # [ 8.929094] gitlab-postgresql-start[919]: CREATE EXTENSION1061gitlab # [ 9.000752] gitlab-postgresql-start[921]: CREATE EXTENSION1062gitlab # [ 9.003804] systemd[1]: Finished gitlab-postgresql.service.1063gitlab # [ 9.286155] gitaly[906]: time="2026-10-17T23:56:33.037Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9061064gitlab # [ 9.286867] gitaly[906]: time="2026-10-17T23:56:33.037Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9061065gitlab # [ 9.287580] gitaly[906]: time="2026-10-17T23:56:33.038Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9061066gitlab # [ 9.288027] gitaly[906]: time="2026-10-17T23:56:33.038Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9061067gitlab # [ 9.288494] gitaly[906]: time="2026-10-17T23:56:33.038Z" level=info msg="Starting Gitaly" pid=906 version=1068gitlab # [ 9.452637] gitaly[906]: time="2026-10-17T23:56:33.204Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=165 pid=9061069gitlab # [ 9.455191] gitaly[906]: time="2026-10-17T23:56:33.204Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9061070gitlab # [ 9.457222] gitaly[906]: time="2026-10-17T23:56:33.204Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9061071gitlab # [ 9.459157] gitaly[906]: time="2026-10-17T23:56:33.204Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-906/git-exec-462094007.d/git pid=9061072gitlab # [ 9.461489] gitaly[906]: time="2026-10-17T23:56:33.208Z" level=info msg="finished detecting git version" duration_ms=3 pid=9061073gitlab # [ 9.463228] gitaly[906]: time="2026-10-17T23:56:33.208Z" level=info msg="using Git version" pid=906 version=2.53.g1074gitlab # [ 9.464783] gitaly[906]: time="2026-10-17T23:56:33.209Z" level=info msg="clearing disk cache object folder" pid=906 storage=default1075gitlab # [ 9.466553] gitaly[906]: time="2026-10-17T23:56:33.209Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache969976568 pid=906 storage=default1076gitlab # [ 9.469323] gitaly[906]: time="2026-10-17T23:56:33.209Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache969976568 pid=906 storage=default1077gitlab # [ 9.472550] gitaly[906]: time="2026-10-17T23:56:33.209Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9061078gitlab # [ 9.475504] gitaly[906]: time="2026-10-17T23:56:33.209Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9061079gitlab # [ 9.478326] gitaly[906]: time="2026-10-17T23:56:33.210Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache969976568 clear_duration_ms=0 pid=906 storage=default1080gitlab # [ 9.499078] gitaly[906]: time="2026-10-17T23:56:33.250Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9061081gitlab # [ 9.499425] gitaly[906]: time="2026-10-17T23:56:33.250Z" level=info msg="counting repositories" pid=9061082gitlab # [ 9.499965] gitaly[906]: time="2026-10-17T23:56:33.250Z" level=info msg="finished tempdir cleaner walk" pid=906 storage=default time_ms=01083gitlab # [ 9.500596] gitaly[906]: time="2026-10-17T23:56:33.250Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=906 schema=unix1084gitlab # [ 9.501118] gitaly[906]: time="2026-10-17T23:56:33.250Z" level=info msg="listening at address" address=/run/gitaly/gitaly-906/sock.d/intern pid=906 schema=unix1085gitlab # [ 9.501707] gitaly[906]: time="2026-10-17T23:56:33.250Z" level=info msg="starting to count repositories" pid=906 storage_path=/var/gitlab/state/repositories1086gitlab # [ 9.510199] gitaly[906]: time="2026-10-17T23:56:33.261Z" level=info msg="completed counting repositories" counting_duration_ms=8 pid=906 storage_path=/var/gitlab/state/repositories1087gitlab # [ 9.511139] gitaly[906]: time="2026-10-17T23:56:33.262Z" level=info msg="completed counting all repositories" counting_duration=12 pid=9061088gitlab # [ 9.515766] gitaly[906]: time="2026-10-17T23:56:33.267Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9061089gitlab # [ 9.516505] gitaly[906]: time="2026-10-17T23:56:33.267Z" level=info msg="Started Gitaly" duration_ms=229 pid=9061090gitlab # [ 9.517040] gitaly[906]: time="2026-10-17T23:56:33.267Z" level=info msg="maintenance: daily scheduled" pid=906 scheduled="2026-10-18 12:00:00 +0000 UTC"1091gitlab # [ 9.520805] gitaly[906]: time="2026-10-17T23:56:33.272Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9061092gitlab # [ 9.932612] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1093gitlab # [ 9.933834] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1094gitlab # [ 9.954400] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1095gitlab # [ 11.360804] gitaly[906]: time="2026-10-17T23:56:35.111Z" level=info msg="License database preloaded" duration_ms=2056 pid=9061096gitlab # [ 13.742548] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds1097gitlab # [ 13.743715] dhcpcd[767]: eth0: adding route to 10.0.2.0/241098gitlab # [ 13.745827] dhcpcd[767]: eth0: adding default route via 10.0.2.21099gitlab # [ 13.842371] systemd[1]: Started DHCP Client.1100gitlab # [ 13.844907] systemd[1]: Reached target Network is Online.1101gitlab # [ 37.408828] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: W, [2026-10-17T23:57:01.159914 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1102gitlab # [ 37.633343] gitlab-workhorse[826]: time="2026-10-17T23:57:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1103gitlab # [ 39.212354] postgres[1283]: [1283] ERROR: relation "feature_gates" does not exist at character 5231104gitlab # [ 39.214596] postgres[1283]: [1283] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1105gitlab # [ 39.216108] postgres[1283]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1106gitlab # [ 39.218078] postgres[1283]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1107gitlab # [ 39.220062] postgres[1283]: attidentity AS identity,1108gitlab # [ 39.221939] postgres[1283]: attgenerated as attgenerated1109gitlab # [ 39.224264] postgres[1283]: FROM pg_attribute a1110gitlab # [ 39.226175] postgres[1283]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1111gitlab # [ 39.228128] postgres[1283]: LEFT JOIN pg_type t ON a.atttypid = t.oid1112gitlab # [ 39.230109] postgres[1283]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1113gitlab # [ 39.231213] postgres[1283]: WHERE a.attrelid = '"feature_gates"'::regclass1114gitlab # [ 39.233142] postgres[1283]: AND a.attnum > 0 AND NOT a.attisdropped1115gitlab # [ 39.235077] postgres[1283]: ORDER BY a.attnum1116gitlab # [ 39.236277] postgres[1283]:1117gitlab # [ 42.502077] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1325]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1118gitlab # [ 42.506726] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1325]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1119gitlab # [ 47.645573] gitlab-workhorse[826]: time="2026-10-17T23:57:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 56.636700] postgres[1392]: [1392] ERROR: relation "table_without_models" does not exist1121gitlab # [ 56.639064] postgres[1392]: [1392] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1122gitlab # [ 57.645529] gitlab-workhorse[826]: time="2026-10-17T23:57:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 67.650672] gitlab-workhorse[826]: time="2026-10-17T23:57:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 68.012119] systemd[1]: Finished gitlab-db-config.service.1125gitlab # [ 68.015390] systemd[1]: Started gitlab-sidekiq.service.1126gitlab # [ 68.018666] systemd[1]: Starting gitlab.service...1127gitlab # [ 68.372361] bundle[1549]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1128gitlab # [ 68.373816] bundle[1549]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1129gitlab # [ 68.374565] bundle[1549]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1130gitlab # [ 71.010332] sidekiq-cluster[1548]: {"severity":"INFO","time":"2026-10-17T23:57:34.745Z","message":"Starting cluster with 1 processes"}1131gitlab # [ 71.102404] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.835Z","pid":1549,"message":"* Enabling systemd notification integration"}1132gitlab # [ 71.104092] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.853Z","pid":1549,"message":"Puma starting in cluster mode..."}1133gitlab # [ 71.105144] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.853Z","pid":1549,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1134gitlab # [ 71.106450] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.853Z","pid":1549,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1135gitlab # [ 71.108046] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.853Z","pid":1549,"message":"* Min threads: 0"}1136gitlab # [ 71.108443] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.853Z","pid":1549,"message":"* Max threads: 4"}1137gitlab # [ 71.109640] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.854Z","pid":1549,"message":"* Environment: production"}1138gitlab # [ 71.110488] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.854Z","pid":1549,"message":"* Master PID: 1549"}1139gitlab # [ 71.111336] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.854Z","pid":1549,"message":"* Workers: 2"}1140gitlab # [ 71.112969] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.854Z","pid":1549,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1141gitlab # [ 71.114943] bundle[1549]: {"timestamp":"2026-10-17T23:57:34.854Z","pid":1549,"message":"* Preloading application"}1142gitlab # [ 77.659421] gitlab-workhorse[826]: time="2026-10-17T23:57:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 87.669224] gitlab-workhorse[826]: time="2026-10-17T23:57:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 93.124393] bundle[1549]: W, [2026-10-17T23:57:56.875789 #1549] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1145gitlab # [ 95.128319] sidekiq-cluster[1580]: 2026-10-17T23:57:58.879Z pid=1580 tid=whw INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1580, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435920896}1146gitlab # [ 95.317342] sidekiq-cluster[1580]: W, [2026-10-17T23:57:59.068927 #1580] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 95.356363] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:57:59.107Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 97.211856] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:00.962Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 97.213788] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:00.962Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 97.263093] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.014Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 97.272300] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.023Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1152gitlab # [ 97.281603] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.033Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1153gitlab # [ 97.286043] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.037Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1154gitlab # [ 97.294806] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.046Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1155gitlab # [ 97.302981] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.054Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 97.310867] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.062Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1157gitlab # [ 97.317580] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.069Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1158gitlab # [ 97.324487] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.076Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1159gitlab # [ 97.331241] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.082Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 97.338735] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.090Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 97.347120] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.098Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 97.354050] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.105Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 97.361034] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.112Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 97.368444] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.120Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 97.375939] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.127Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 97.382877] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.134Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 97.391358] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.143Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 97.399874] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.151Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 97.407902] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.159Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 97.416878] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.168Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 97.425365] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.177Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 97.433365] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.185Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 97.440796] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.192Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 97.447906] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.199Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 97.454574] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.206Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 97.461039] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.212Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 97.467393] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.219Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 97.480580] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.232Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 97.490149] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.241Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 97.499081] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.250Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 97.507420] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.259Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 97.512224] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.263Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 97.516939] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.268Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 97.520157] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.271Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 97.522185] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.273Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 97.524483] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.276Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 97.528541] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.280Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 97.532268] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.284Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 97.535817] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.287Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 97.539647] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.291Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 97.543431] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.295Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 97.549184] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.300Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 97.554036] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.305Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 97.559702] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.311Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 97.564142] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.315Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 97.568685] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.320Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 97.573539] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.325Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 97.578757] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.330Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 97.583640] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.335Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 97.588745] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.340Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 97.594045] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.345Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 97.607121] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.358Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 97.611636] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.363Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 97.615540] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.367Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 97.619454] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.371Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 97.623124] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.374Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 97.625826] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.377Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 97.629269] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.381Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 97.633551] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.385Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 97.637246] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.388Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 97.640554] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.392Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 97.670208] gitlab-workhorse[826]: time="2026-10-17T23:58:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1213gitlab # [ 97.673602] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.424Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1214gitlab # [ 97.681232] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.432Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1215gitlab # [ 97.687902] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.439Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1216gitlab # [ 97.694223] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.445Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1217gitlab # [ 97.700304] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.452Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1218gitlab # [ 97.705637] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.457Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1219gitlab # [ 97.711867] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.463Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1220gitlab # [ 97.717284] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.469Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1221gitlab # [ 97.723498] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.475Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1222gitlab # [ 97.728612] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.480Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1223gitlab # [ 97.733932] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.485Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1224gitlab # [ 97.740200] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.491Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1225gitlab # [ 97.746504] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.498Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1226gitlab # [ 97.753474] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.505Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1227gitlab # [ 97.759828] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.511Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1228gitlab # [ 97.766329] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.517Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1229gitlab # [ 97.771549] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.523Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1230gitlab # [ 97.777296] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.528Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1231gitlab # [ 97.782473] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.534Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1232gitlab # [ 97.787861] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.539Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1233gitlab # [ 97.795239] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.546Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1234gitlab # [ 97.800792] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.552Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1235gitlab # [ 97.806938] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.558Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1236gitlab # [ 97.812447] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.564Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1237gitlab # [ 97.819093] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.570Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1238gitlab # [ 97.824614] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.576Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1239gitlab # [ 97.830246] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.581Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1240gitlab # [ 97.835488] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.587Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1241gitlab # [ 97.841224] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.592Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1242gitlab # [ 97.846315] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.597Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1243gitlab # [ 97.852106] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.603Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1244gitlab # [ 97.857460] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.609Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1245gitlab # [ 97.864328] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.615Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1246gitlab # [ 97.870943] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.622Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1247gitlab # [ 97.876936] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.628Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1248gitlab # [ 97.882323] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.633Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1249gitlab # [ 97.903228] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.654Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1250gitlab # [ 97.907573] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.659Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1251gitlab # [ 97.912747] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.664Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1252gitlab # [ 97.918909] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.670Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1253gitlab # [ 97.924956] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.676Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1254gitlab # [ 97.930486] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.682Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1255gitlab # [ 97.936580] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.688Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1256gitlab # [ 97.941272] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.692Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1257gitlab # [ 97.946057] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.697Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1258gitlab # [ 97.952511] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.704Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1259gitlab # [ 97.957635] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:01.709Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1260gitlab # [ 107.679424] gitlab-workhorse[826]: time="2026-10-17T23:58:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 117.688597] gitlab-workhorse[826]: time="2026-10-17T23:58:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 121.080182] postgres[2009]: [2009] ERROR: relation "table_without_models" does not exist1263gitlab # [ 121.080757] postgres[2009]: [2009] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1264gitlab # [ 122.611263] postgres[2029]: [2029] ERROR: relation "table_without_models" does not exist1265gitlab # [ 122.612338] postgres[2029]: [2029] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1266gitlab # [ 123.625682] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:27.376Z","message":"Booted Rails 7.2.3.1 application in production environment"}1267gitlab # [ 123.629914] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:27.381Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1268gitlab # [ 123.631455] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:27.381Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1269gitlab # [ 123.632579] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:27.381Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1270gitlab # [ 123.643399] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:27.395Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1271gitlab # [ 124.887715] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:28.639Z","message":"Cleaning working queues"}1272gitlab # [ 124.892741] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:28.644Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ff6e0bbd1402e4201d4493d7","created_at":"2026-10-17T23:57:31.415Z","trace_propagation_headers":{"sentry-trace":"2b1e66c7d1be423ebf56bbc50f194600-89334ef76dae470e","baggage":"sentry-trace_id=2b1e66c7d1be423ebf56bbc50f194600,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8a7ef473c4d78550f2de7978895c5d74","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T23:57:31.422Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ff6e0bbd1402e4201d4493d7: start","job_status":"start","queue_duration_s":57.221804,"scheduling_latency_s":57.221867}1273gitlab # [ 125.070329] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:58:28.821Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ff6e0bbd1402e4201d4493d7","created_at":"2026-10-17T23:57:31.415Z","trace_propagation_headers":{"sentry-trace":"2b1e66c7d1be423ebf56bbc50f194600-89334ef76dae470e","baggage":"sentry-trace_id=2b1e66c7d1be423ebf56bbc50f194600,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8a7ef473c4d78550f2de7978895c5d74","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T23:57:31.422Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ff6e0bbd1402e4201d4493d7: done: 0.177754 sec","job_status":"done","queue_duration_s":57.221804,"scheduling_latency_s":57.221867,"redis_calls":29,"redis_duration_s":0.004918,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.002662,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08076026400000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.177754,"completed_at":"2026-10-17T23:58:28.821Z","load_balancing_strategy":"primary","db_duration_s":0.04671,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1274gitlab # [ 125.301568] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.052Z","pid":1549,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1275gitlab # [ 125.303155] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.052Z","pid":1549,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1276gitlab # [ 125.303838] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.052Z","pid":1549,"message":"! #\u003cThread:0x00007d80e25c9870 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1277gitlab # [ 125.305503] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.052Z","pid":1549,"message":"! #\u003cThread:0x00007d80e27c2758 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1278gitlab # [ 125.306908] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.052Z","pid":1549,"message":"Use Ctrl-C to stop"}1279gitlab # [ 125.308501] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.053Z","pid":1549,"message":"Sending status to systemd every 1.0 sec"}1280gitlab # [ 125.979322] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.730Z","pid":1549,"message":"- Worker 1 (PID: 2124) booted in 0.61s, phase: 0"}1281gitlab # [ 125.983298] bundle[1549]: {"timestamp":"2026-10-17T23:58:29.734Z","pid":1549,"message":"- Worker 0 (PID: 2120) booted in 0.63s, phase: 0"}1282gitlab # [ 125.987961] systemd[1]: Started gitlab.service.1283gitlab # [ 125.989790] systemd[1]: Reached target Common target for all GitLab services..1284gitlab # [ 125.994927] systemd[1]: Starting setup-gitlab.service...1285gitlab # [ 126.010301] setup-gitlab-start[2157]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1286gitlab # [ 127.892189] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:58:31 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 18571287gitlab # [ 127.897027] setup-gitlab-start[2157]: + TOKEN=nixbot-test-token-of-20-chars1288gitlab # [ 127.897719] setup-gitlab-start[2157]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1289gitlab # [ 127.920662] runuser[2179]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1290gitlab # [ 128.291873] setup-gitlab-start[2180]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1291gitlab # [ 128.293502] setup-gitlab-start[2180]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1292gitlab # [ 128.294560] setup-gitlab-start[2180]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1293gitlab # [ 128.860588] setup-gitlab-start[2180]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1294gitlab # [ 128.861777] setup-gitlab-start[2180]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1295gitlab # [ 128.862480] setup-gitlab-start[2180]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1296gitlab # [ 153.068898] setup-gitlab-start[2180]: W, [2026-10-17T23:58:56.819947 #2180] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1297gitlab # [ 159.067363] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:02.818Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc9423c61bedeb0e6102dd76","created_at":"2026-10-17T23:59:02.753Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59959f4ce9df57744a8b385302d58bea","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.816Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc9423c61bedeb0e6102dd76: start","job_status":"start","queue_duration_s":0.001519,"scheduling_latency_s":0.001543}1298gitlab # [ 159.181863] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:02.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dc9423c61bedeb0e6102dd76","created_at":"2026-10-17T23:59:02.753Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59959f4ce9df57744a8b385302d58bea","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.816Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dc9423c61bedeb0e6102dd76: done: 0.115126 sec","job_status":"done","queue_duration_s":0.001519,"scheduling_latency_s":0.001543,"redis_calls":13,"redis_duration_s":0.009876,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004605,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.016299,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.115126,"completed_at":"2026-10-17T23:59:02.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029054,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1299gitlab # [ 159.247181] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:02.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fea1797c8bc49e4b2bf2d589","created_at":"2026-10-17T23:59:02.824Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e7f4d2cf859aadc2bfca74172af0de9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.861Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fea1797c8bc49e4b2bf2d589: start","job_status":"start","queue_duration_s":0.136284,"scheduling_latency_s":0.136309}1300gitlab # [ 159.261443] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.012Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1301gitlab # [ 159.274947] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"fea1797c8bc49e4b2bf2d589","created_at":"2026-10-17T23:59:02.824Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e7f4d2cf859aadc2bfca74172af0de9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.861Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-fea1797c8bc49e4b2bf2d589: done: 0.028738 sec","job_status":"done","queue_duration_s":0.136284,"scheduling_latency_s":0.136309,"redis_calls":10,"redis_duration_s":0.0038710000000000003,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002017,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000506768,"duration_s":0.028738,"completed_at":"2026-10-17T23:59:03.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 159.276763] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c816ede8053c5cea11fcd7f8","created_at":"2026-10-17T23:59:02.870Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82fa247baa0458bdd590696f4f0e9900","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.876Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c816ede8053c5cea11fcd7f8: start","job_status":"start","queue_duration_s":0.150964,"scheduling_latency_s":0.150978}1303gitlab # [ 159.680723] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c816ede8053c5cea11fcd7f8","created_at":"2026-10-17T23:59:02.870Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82fa247baa0458bdd590696f4f0e9900","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.876Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c816ede8053c5cea11fcd7f8: done: 0.404446 sec","job_status":"done","queue_duration_s":0.150964,"scheduling_latency_s":0.150978,"redis_calls":565,"redis_duration_s":0.207728,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.206074,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.215694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000437486,"duration_s":0.404446,"completed_at":"2026-10-17T23:59:03.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 159.717606] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b284cf909df836911d16eeab","created_at":"2026-10-17T23:59:02.890Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c69c979a3ac0f79b09bf80a5c2a95f87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.896Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b284cf909df836911d16eeab: start","job_status":"start","queue_duration_s":0.537445,"scheduling_latency_s":0.53747}1305gitlab # [ 159.730871] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.446Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1306gitlab # [ 159.733879] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b284cf909df836911d16eeab","created_at":"2026-10-17T23:59:02.890Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c69c979a3ac0f79b09bf80a5c2a95f87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:02.896Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b284cf909df836911d16eeab: done: 0.016293 sec","job_status":"done","queue_duration_s":0.537445,"scheduling_latency_s":0.53747,"redis_calls":10,"redis_duration_s":0.001798,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202261,"duration_s":0.016293,"completed_at":"2026-10-17T23:59:03.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 159.771490] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"771749e0fa35eb3c2cb5b4d1","created_at":"2026-10-17T23:59:02.917Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d89e9a4b277b5223622cc4448a32a1ca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-17T23:59:02.925Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-771749e0fa35eb3c2cb5b4d1: start","job_status":"start","queue_duration_s":0.526188,"scheduling_latency_s":0.5262}1308gitlab # [ 159.783397] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.457Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1309gitlab # [ 159.786843] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"771749e0fa35eb3c2cb5b4d1","created_at":"2026-10-17T23:59:02.917Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d89e9a4b277b5223622cc4448a32a1ca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-17T23:59:02.925Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-771749e0fa35eb3c2cb5b4d1: done: 0.010406 sec","job_status":"done","queue_duration_s":0.526188,"scheduling_latency_s":0.5262,"redis_calls":10,"redis_duration_s":0.001189,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197231,"duration_s":0.010406,"completed_at":"2026-10-17T23:59:03.461Z","load_balancing_strategy":"primary","db_duration_s":0.000427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 159.823978] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ddcd1b5173f5541bce99005f","created_at":"2026-10-17T23:59:02.995Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9982c02d60b5b42220c91ed0be23407d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.006Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ddcd1b5173f5541bce99005f: start","job_status":"start","queue_duration_s":0.456005,"scheduling_latency_s":0.456019}1311gitlab # [ 159.824623] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ddcd1b5173f5541bce99005f","created_at":"2026-10-17T23:59:02.995Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9982c02d60b5b42220c91ed0be23407d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.006Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ddcd1b5173f5541bce99005f: done: 0.053224 sec","job_status":"done","queue_duration_s":0.456005,"scheduling_latency_s":0.456019,"redis_calls":12,"redis_duration_s":0.002228,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000377143,"exclusive_lock_hold_duration_s":0.027073273000000002,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.053224,"completed_at":"2026-10-17T23:59:03.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 159.837214] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b64d40bfd19b3b2655f8452f","created_at":"2026-10-17T23:59:03.008Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5b5f6992290e678a893d6359b209cf7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.013Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b64d40bfd19b3b2655f8452f: start","job_status":"start","queue_duration_s":0.50335,"scheduling_latency_s":0.503364}1313gitlab # [ 159.850465] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.524Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1314gitlab # [ 159.853194] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.528Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b64d40bfd19b3b2655f8452f","created_at":"2026-10-17T23:59:03.008Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5b5f6992290e678a893d6359b209cf7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.013Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b64d40bfd19b3b2655f8452f: done: 0.012006 sec","job_status":"done","queue_duration_s":0.50335,"scheduling_latency_s":0.503364,"redis_calls":10,"redis_duration_s":0.002136,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000266235,"duration_s":0.012006,"completed_at":"2026-10-17T23:59:03.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000474,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 159.922792] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6c7c6dc269664543e0697c25","created_at":"2026-10-17T23:59:03.019Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23b3e34108a106b1e86ab66d2fc270cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.030Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6c7c6dc269664543e0697c25: start","job_status":"start","queue_duration_s":0.500097,"scheduling_latency_s":0.500109}1316gitlab # [ 159.923552] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.548Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6c7c6dc269664543e0697c25","created_at":"2026-10-17T23:59:03.019Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23b3e34108a106b1e86ab66d2fc270cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.030Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6c7c6dc269664543e0697c25: done: 0.018359 sec","job_status":"done","queue_duration_s":0.500097,"scheduling_latency_s":0.500109,"redis_calls":12,"redis_duration_s":0.002555,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285511,"duration_s":0.018359,"completed_at":"2026-10-17T23:59:03.548Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 159.963122] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.549Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8b445b058208d9c538f11be5","created_at":"2026-10-17T23:59:03.032Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.080Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8b445b058208d9c538f11be5: start","job_status":"start","queue_duration_s":0.468891,"scheduling_latency_s":0.468904}1318gitlab # [ 160.034710] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8b445b058208d9c538f11be5","created_at":"2026-10-17T23:59:03.032Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.080Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8b445b058208d9c538f11be5: done: 0.236562 sec","job_status":"done","queue_duration_s":0.468891,"scheduling_latency_s":0.468904,"redis_calls":71,"redis_duration_s":0.012008999999999999,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002213,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000543,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008674,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239136,"duration_s":0.236562,"completed_at":"2026-10-17T23:59:03.786Z","load_balancing_strategy":"primary","db_duration_s":0.001947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 160.073733] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"95fc08a24e81f4a95e95166f","created_at":"2026-10-17T23:59:03.093Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4f2c8d3cd5e142e40164113daa53a36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.099Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-95fc08a24e81f4a95e95166f: start","job_status":"start","queue_duration_s":0.725516,"scheduling_latency_s":0.725546}1320gitlab # [ 160.087065] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"95fc08a24e81f4a95e95166f","created_at":"2026-10-17T23:59:03.093Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4f2c8d3cd5e142e40164113daa53a36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.099Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-95fc08a24e81f4a95e95166f: done: 0.013862 sec","job_status":"done","queue_duration_s":0.725516,"scheduling_latency_s":0.725546,"redis_calls":10,"redis_duration_s":0.001339,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218463,"duration_s":0.013862,"completed_at":"2026-10-17T23:59:03.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 160.107311] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"49f8c8b51b245e906f736c3f","created_at":"2026-10-17T23:59:03.104Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd8383bf37bdd93331b0a2691710c78f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.109Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-49f8c8b51b245e906f736c3f: start","job_status":"start","queue_duration_s":0.729795,"scheduling_latency_s":0.729808}1322gitlab # [ 160.107889] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"49f8c8b51b245e906f736c3f","created_at":"2026-10-17T23:59:03.104Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd8383bf37bdd93331b0a2691710c78f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.109Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-49f8c8b51b245e906f736c3f: done: 0.014609 sec","job_status":"done","queue_duration_s":0.729795,"scheduling_latency_s":0.729808,"redis_calls":12,"redis_duration_s":0.0015279999999999998,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000308977,"exclusive_lock_hold_duration_s":0.004237689,"duration_s":0.014609,"completed_at":"2026-10-17T23:59:03.854Z","load_balancing_strategy":"primary","db_duration_s":0.002008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 160.165077] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a8679d802c23cb0a77adfc56","created_at":"2026-10-17T23:59:03.115Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2391b6b9010e158d1fa3a49683e7236","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.120Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a8679d802c23cb0a77adfc56: start","job_status":"start","queue_duration_s":0.734435,"scheduling_latency_s":0.734447}1324gitlab # [ 160.201224] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.952Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a8679d802c23cb0a77adfc56","created_at":"2026-10-17T23:59:03.115Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2391b6b9010e158d1fa3a49683e7236","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.120Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a8679d802c23cb0a77adfc56: done: 0.097772 sec","job_status":"done","queue_duration_s":0.734435,"scheduling_latency_s":0.734447,"redis_calls":16,"redis_duration_s":0.079952,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001025,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.078679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213435,"duration_s":0.097772,"completed_at":"2026-10-17T23:59:03.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 160.239943] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:03.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"90d4b25fc48b30ac96fbfd91","created_at":"2026-10-17T23:59:03.133Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.138Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-90d4b25fc48b30ac96fbfd91: start","job_status":"start","queue_duration_s":0.852266,"scheduling_latency_s":0.852305}1326gitlab # [ 160.278795] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"90d4b25fc48b30ac96fbfd91","created_at":"2026-10-17T23:59:03.133Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.138Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-90d4b25fc48b30ac96fbfd91: done: 0.039177 sec","job_status":"done","queue_duration_s":0.852266,"scheduling_latency_s":0.852305,"redis_calls":19,"redis_duration_s":0.003713,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000898,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000242,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001918,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362337,"duration_s":0.039177,"completed_at":"2026-10-17T23:59:04.030Z","load_balancing_strategy":"primary","db_duration_s":0.001637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 160.317356] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.068Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"927f2b7c35c2f82610e6907a","created_at":"2026-10-17T23:59:03.143Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef7934a279ab41b600cc179a663c439d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.147Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-927f2b7c35c2f82610e6907a: start","job_status":"start","queue_duration_s":0.920969,"scheduling_latency_s":0.920991}1328gitlab # [ 160.374163] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"927f2b7c35c2f82610e6907a","created_at":"2026-10-17T23:59:03.143Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef7934a279ab41b600cc179a663c439d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.147Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-927f2b7c35c2f82610e6907a: done: 0.056636 sec","job_status":"done","queue_duration_s":0.920969,"scheduling_latency_s":0.920991,"redis_calls":14,"redis_duration_s":0.003044,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001176,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000649244,"exclusive_lock_hold_duration_s":0.032157439,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.056636,"completed_at":"2026-10-17T23:59:04.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 160.415678] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b7571e30f8b31c43ce5e7cba","created_at":"2026-10-17T23:59:03.154Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb512909881f2c4f0fcd98d69ff4cf26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-17T23:59:03.161Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b7571e30f8b31c43ce5e7cba: start","job_status":"start","queue_duration_s":1.005785,"scheduling_latency_s":1.00583}1330gitlab # [ 160.435060] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.186Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1331gitlab # [ 160.442149] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b7571e30f8b31c43ce5e7cba","created_at":"2026-10-17T23:59:03.154Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb512909881f2c4f0fcd98d69ff4cf26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-17T23:59:03.161Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b7571e30f8b31c43ce5e7cba: done: 0.02687 sec","job_status":"done","queue_duration_s":1.005785,"scheduling_latency_s":1.00583,"redis_calls":10,"redis_duration_s":0.0037099999999999998,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218743,"duration_s":0.02687,"completed_at":"2026-10-17T23:59:04.193Z","load_balancing_strategy":"primary","db_duration_s":0.000448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 160.479809] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"074e72f7681e72e5297d7b5b","created_at":"2026-10-17T23:59:03.167Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad5fc277a3ba3e81a8573b2aa0cec083","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.172Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-074e72f7681e72e5297d7b5b: start","job_status":"start","queue_duration_s":1.058346,"scheduling_latency_s":1.058367}1333gitlab # [ 160.610534] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"074e72f7681e72e5297d7b5b","created_at":"2026-10-17T23:59:03.167Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad5fc277a3ba3e81a8573b2aa0cec083","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.172Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-074e72f7681e72e5297d7b5b: done: 0.130611 sec","job_status":"done","queue_duration_s":1.058346,"scheduling_latency_s":1.058367,"redis_calls":12,"redis_duration_s":0.001936,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000832,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000376025,"exclusive_lock_hold_duration_s":0.103998135,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.130611,"completed_at":"2026-10-17T23:59:04.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 160.650707] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ed0e2508ba4e5c1d0501118a","created_at":"2026-10-17T23:59:03.181Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e14c9b7e2454b56e9dee9f0403593f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-17T23:59:03.187Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ed0e2508ba4e5c1d0501118a: start","job_status":"start","queue_duration_s":1.214385,"scheduling_latency_s":1.214406}1335gitlab # [ 160.680830] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ed0e2508ba4e5c1d0501118a","created_at":"2026-10-17T23:59:03.181Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e14c9b7e2454b56e9dee9f0403593f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-17T23:59:03.187Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ed0e2508ba4e5c1d0501118a: done: 0.030181 sec","job_status":"done","queue_duration_s":1.214385,"scheduling_latency_s":1.214406,"redis_calls":10,"redis_duration_s":0.001361,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223213,"duration_s":0.030181,"completed_at":"2026-10-17T23:59:04.432Z","load_balancing_strategy":"primary","db_duration_s":0.002358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 160.717877] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c9086664dd85bff529d7dc6f","created_at":"2026-10-17T23:59:03.196Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b31fec4205f06e219c5d7d2fecf7d5a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.202Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c9086664dd85bff529d7dc6f: start","job_status":"start","queue_duration_s":1.26657,"scheduling_latency_s":1.266591}1337gitlab # [ 160.744069] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.495Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c9086664dd85bff529d7dc6f","created_at":"2026-10-17T23:59:03.196Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b31fec4205f06e219c5d7d2fecf7d5a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.202Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c9086664dd85bff529d7dc6f: done: 0.02622 sec","job_status":"done","queue_duration_s":1.26657,"scheduling_latency_s":1.266591,"redis_calls":12,"redis_duration_s":0.001607,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000328254,"exclusive_lock_hold_duration_s":0.001935721,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.02622,"completed_at":"2026-10-17T23:59:04.495Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 160.783795] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"51f82b3e0dded0c54756155d","created_at":"2026-10-17T23:59:03.212Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fed1446f73eded740c05a829b86d4821","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.218Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-51f82b3e0dded0c54756155d: start","job_status":"start","queue_duration_s":1.316269,"scheduling_latency_s":1.316298}1339gitlab # [ 160.792487] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.544Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1340gitlab # [ 160.804317] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"51f82b3e0dded0c54756155d","created_at":"2026-10-17T23:59:03.212Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fed1446f73eded740c05a829b86d4821","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.218Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-51f82b3e0dded0c54756155d: done: 0.020645 sec","job_status":"done","queue_duration_s":1.316269,"scheduling_latency_s":1.316298,"redis_calls":10,"redis_duration_s":0.008379,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242769,"duration_s":0.020645,"completed_at":"2026-10-17T23:59:04.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 160.843932] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c116949820b75b0883c4a347","created_at":"2026-10-17T23:59:03.234Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48464393c771c205fbdf38e4921f8539","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.240Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c116949820b75b0883c4a347: start","job_status":"start","queue_duration_s":1.354587,"scheduling_latency_s":1.354633}1342gitlab # [ 160.884528] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c116949820b75b0883c4a347","created_at":"2026-10-17T23:59:03.234Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48464393c771c205fbdf38e4921f8539","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.240Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c116949820b75b0883c4a347: done: 0.040415 sec","job_status":"done","queue_duration_s":1.354587,"scheduling_latency_s":1.354633,"redis_calls":10,"redis_duration_s":0.002422,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001516,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000528,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.040415,"completed_at":"2026-10-17T23:59:04.635Z","load_balancing_strategy":"primary","db_duration_s":0.009566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 160.924645] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e39df63288a8621ee871d09f","created_at":"2026-10-17T23:59:03.252Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"111ea4b71439980c1b05802538bcd000","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.258Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e39df63288a8621ee871d09f: start","job_status":"start","queue_duration_s":1.417613,"scheduling_latency_s":1.417704}1344gitlab # [ 160.960138] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e39df63288a8621ee871d09f","created_at":"2026-10-17T23:59:03.252Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-3b1bd3d57f164c5a","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"111ea4b71439980c1b05802538bcd000","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.258Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e39df63288a8621ee871d09f: done: 0.035525 sec","job_status":"done","queue_duration_s":1.417613,"scheduling_latency_s":1.417704,"redis_calls":10,"redis_duration_s":0.00301,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000522692,"duration_s":0.035525,"completed_at":"2026-10-17T23:59:04.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 161.000245] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37231285c6b16c503c64e2ac","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37231285c6b16c503c64e2ac: start","job_status":"start","queue_duration_s":0.971377,"scheduling_latency_s":0.971421}1346gitlab # [ 161.027535] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37231285c6b16c503c64e2ac","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37231285c6b16c503c64e2ac: done: 0.027732 sec","job_status":"done","queue_duration_s":0.971377,"scheduling_latency_s":0.971421,"redis_calls":16,"redis_duration_s":0.002187,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201143,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027732,"completed_at":"2026-10-17T23:59:04.778Z","load_balancing_strategy":"primary","db_duration_s":0.000597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 161.064847] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5094983eaf42c4616d0cb5fa","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5094983eaf42c4616d0cb5fa: start","job_status":"start","queue_duration_s":1.035898,"scheduling_latency_s":1.036065}1348gitlab # [ 161.088555] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5094983eaf42c4616d0cb5fa","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5094983eaf42c4616d0cb5fa: done: 0.023615 sec","job_status":"done","queue_duration_s":1.035898,"scheduling_latency_s":1.036065,"redis_calls":13,"redis_duration_s":0.002543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023615,"completed_at":"2026-10-17T23:59:04.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 161.124068] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cd2b3fc0b4947e37c3e2d86","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cd2b3fc0b4947e37c3e2d86: start","job_status":"start","queue_duration_s":1.095086,"scheduling_latency_s":1.095123}1350gitlab # [ 161.155067] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cd2b3fc0b4947e37c3e2d86","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cd2b3fc0b4947e37c3e2d86: done: 0.031194 sec","job_status":"done","queue_duration_s":1.095086,"scheduling_latency_s":1.095123,"redis_calls":13,"redis_duration_s":0.002885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031194,"completed_at":"2026-10-17T23:59:04.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 161.190627] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a9ca421027e8612380a9fd7","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a9ca421027e8612380a9fd7: start","job_status":"start","queue_duration_s":1.16192,"scheduling_latency_s":1.161957}1352gitlab # [ 161.213062] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:04.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a9ca421027e8612380a9fd7","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a9ca421027e8612380a9fd7: done: 0.02249 sec","job_status":"done","queue_duration_s":1.16192,"scheduling_latency_s":1.161957,"redis_calls":13,"redis_duration_s":0.0024679999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02249,"completed_at":"2026-10-17T23:59:04.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 161.248749] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b04096edb883fcfcbdef57b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b04096edb883fcfcbdef57b: start","job_status":"start","queue_duration_s":1.220026,"scheduling_latency_s":1.220065}1354gitlab # [ 161.279868] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b04096edb883fcfcbdef57b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b04096edb883fcfcbdef57b: done: 0.031125 sec","job_status":"done","queue_duration_s":1.220026,"scheduling_latency_s":1.220065,"redis_calls":13,"redis_duration_s":0.002887,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001744,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031125,"completed_at":"2026-10-17T23:59:05.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 161.314894] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4319399436e5320230be0fcf","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4319399436e5320230be0fcf: start","job_status":"start","queue_duration_s":1.286355,"scheduling_latency_s":1.286384}1356gitlab # [ 161.328172] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4319399436e5320230be0fcf","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4319399436e5320230be0fcf: done: 0.013365 sec","job_status":"done","queue_duration_s":1.286355,"scheduling_latency_s":1.286384,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013365,"completed_at":"2026-10-17T23:59:05.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 161.364439] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eaba6175dd68030d47819aa","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eaba6175dd68030d47819aa: start","job_status":"start","queue_duration_s":1.335688,"scheduling_latency_s":1.335731}1358gitlab # [ 161.387027] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eaba6175dd68030d47819aa","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eaba6175dd68030d47819aa: done: 0.02275 sec","job_status":"done","queue_duration_s":1.335688,"scheduling_latency_s":1.335731,"redis_calls":13,"redis_duration_s":0.002413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02275,"completed_at":"2026-10-17T23:59:05.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 161.421899] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76e22ff1b51e4230882cc991","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76e22ff1b51e4230882cc991: start","job_status":"start","queue_duration_s":1.393371,"scheduling_latency_s":1.393402}1360gitlab # [ 161.449391] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76e22ff1b51e4230882cc991","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76e22ff1b51e4230882cc991: done: 0.027098 sec","job_status":"done","queue_duration_s":1.393371,"scheduling_latency_s":1.393402,"redis_calls":13,"redis_duration_s":0.002229,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001443,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027098,"completed_at":"2026-10-17T23:59:05.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 161.484704] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50d79fe7a30b712b0769cf01","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50d79fe7a30b712b0769cf01: start","job_status":"start","queue_duration_s":1.456097,"scheduling_latency_s":1.456135}1362gitlab # [ 161.498345] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50d79fe7a30b712b0769cf01","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50d79fe7a30b712b0769cf01: done: 0.013652 sec","job_status":"done","queue_duration_s":1.456097,"scheduling_latency_s":1.456135,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013652,"completed_at":"2026-10-17T23:59:05.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 161.533521] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3135e774cc92fcfaed7d158d","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3135e774cc92fcfaed7d158d: start","job_status":"start","queue_duration_s":1.504804,"scheduling_latency_s":1.504904}1364gitlab # [ 161.565945] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3135e774cc92fcfaed7d158d","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3135e774cc92fcfaed7d158d: done: 0.03191 sec","job_status":"done","queue_duration_s":1.504804,"scheduling_latency_s":1.504904,"redis_calls":13,"redis_duration_s":0.0024879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001646,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03191,"completed_at":"2026-10-17T23:59:05.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 161.603783] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"239fd22d3a548fc474727f43","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-239fd22d3a548fc474727f43: start","job_status":"start","queue_duration_s":1.575009,"scheduling_latency_s":1.575054}1366gitlab # [ 161.635292] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"239fd22d3a548fc474727f43","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-239fd22d3a548fc474727f43: done: 0.031545 sec","job_status":"done","queue_duration_s":1.575009,"scheduling_latency_s":1.575054,"redis_calls":13,"redis_duration_s":0.002509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031545,"completed_at":"2026-10-17T23:59:05.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 161.671707] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73dcaf012cf51a0d42e92347","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73dcaf012cf51a0d42e92347: start","job_status":"start","queue_duration_s":1.642993,"scheduling_latency_s":1.643033}1368gitlab # [ 161.702573] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73dcaf012cf51a0d42e92347","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73dcaf012cf51a0d42e92347: done: 0.03057 sec","job_status":"done","queue_duration_s":1.642993,"scheduling_latency_s":1.643033,"redis_calls":13,"redis_duration_s":0.002469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03057,"completed_at":"2026-10-17T23:59:05.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 161.739868] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6220b995a452ad25841dbe0a","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6220b995a452ad25841dbe0a: start","job_status":"start","queue_duration_s":1.711079,"scheduling_latency_s":1.711125}1370gitlab # [ 161.764300] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6220b995a452ad25841dbe0a","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6220b995a452ad25841dbe0a: done: 0.024415 sec","job_status":"done","queue_duration_s":1.711079,"scheduling_latency_s":1.711125,"redis_calls":13,"redis_duration_s":0.0036950000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024415,"completed_at":"2026-10-17T23:59:05.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 161.801711] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3ce64edfb00fec329e780b3","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3ce64edfb00fec329e780b3: start","job_status":"start","queue_duration_s":1.772434,"scheduling_latency_s":1.772472}1372gitlab # [ 161.833479] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3ce64edfb00fec329e780b3","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3ce64edfb00fec329e780b3: done: 0.032201 sec","job_status":"done","queue_duration_s":1.772434,"scheduling_latency_s":1.772472,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032201,"completed_at":"2026-10-17T23:59:05.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 161.871124] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7171330e8e7a06b54c61531d","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7171330e8e7a06b54c61531d: start","job_status":"start","queue_duration_s":1.842304,"scheduling_latency_s":1.842349}1374gitlab # [ 161.894828] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7171330e8e7a06b54c61531d","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7171330e8e7a06b54c61531d: done: 0.023773 sec","job_status":"done","queue_duration_s":1.842304,"scheduling_latency_s":1.842349,"redis_calls":13,"redis_duration_s":0.003616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00245,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023773,"completed_at":"2026-10-17T23:59:05.645Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 161.932789] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91e93ccbc84f19e0aceb6a7b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91e93ccbc84f19e0aceb6a7b: start","job_status":"start","queue_duration_s":1.904007,"scheduling_latency_s":1.904051}1376gitlab # [ 161.957547] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91e93ccbc84f19e0aceb6a7b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91e93ccbc84f19e0aceb6a7b: done: 0.024724 sec","job_status":"done","queue_duration_s":1.904007,"scheduling_latency_s":1.904051,"redis_calls":13,"redis_duration_s":0.004031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002499,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024724,"completed_at":"2026-10-17T23:59:05.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 161.994986] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"129f0bf2da0a4a188451a4fa","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-129f0bf2da0a4a188451a4fa: start","job_status":"start","queue_duration_s":1.966187,"scheduling_latency_s":1.966234}1378gitlab # [ 162.018710] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"129f0bf2da0a4a188451a4fa","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-129f0bf2da0a4a188451a4fa: done: 0.023736 sec","job_status":"done","queue_duration_s":1.966187,"scheduling_latency_s":1.966234,"redis_calls":13,"redis_duration_s":0.003641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002483,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023736,"completed_at":"2026-10-17T23:59:05.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 162.055966] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2d60010bd8dee1b4fc5077c","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2d60010bd8dee1b4fc5077c: start","job_status":"start","queue_duration_s":2.027181,"scheduling_latency_s":2.027218}1380gitlab # [ 162.082617] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2d60010bd8dee1b4fc5077c","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2d60010bd8dee1b4fc5077c: done: 0.026953 sec","job_status":"done","queue_duration_s":2.027181,"scheduling_latency_s":2.027218,"redis_calls":13,"redis_duration_s":0.002288,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026953,"completed_at":"2026-10-17T23:59:05.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 162.118465] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33d5f3c757d7001a5dbbee1b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33d5f3c757d7001a5dbbee1b: start","job_status":"start","queue_duration_s":2.089324,"scheduling_latency_s":2.089345}1382gitlab # [ 162.142799] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33d5f3c757d7001a5dbbee1b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33d5f3c757d7001a5dbbee1b: done: 0.024164 sec","job_status":"done","queue_duration_s":2.089324,"scheduling_latency_s":2.089345,"redis_calls":13,"redis_duration_s":0.001858,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024164,"completed_at":"2026-10-17T23:59:05.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 162.178502] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbacfea874927fc9fb8756a4","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbacfea874927fc9fb8756a4: start","job_status":"start","queue_duration_s":2.149745,"scheduling_latency_s":2.149784}1384gitlab # [ 162.209967] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbacfea874927fc9fb8756a4","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbacfea874927fc9fb8756a4: done: 0.031045 sec","job_status":"done","queue_duration_s":2.149745,"scheduling_latency_s":2.149784,"redis_calls":13,"redis_duration_s":0.002424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001576,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031045,"completed_at":"2026-10-17T23:59:05.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 162.245574] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:05.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd356cb16d145ea3fe46966f","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd356cb16d145ea3fe46966f: start","job_status":"start","queue_duration_s":2.216978,"scheduling_latency_s":2.217007}1386gitlab # [ 162.258275] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd356cb16d145ea3fe46966f","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd356cb16d145ea3fe46966f: done: 0.012774 sec","job_status":"done","queue_duration_s":2.216978,"scheduling_latency_s":2.217007,"redis_calls":13,"redis_duration_s":0.0027860000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012774,"completed_at":"2026-10-17T23:59:06.009Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 162.294403] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0823d47149f8c5ca81e03c8f","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0823d47149f8c5ca81e03c8f: start","job_status":"start","queue_duration_s":2.265633,"scheduling_latency_s":2.265677}1388gitlab # [ 162.317414] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0823d47149f8c5ca81e03c8f","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0823d47149f8c5ca81e03c8f: done: 0.023078 sec","job_status":"done","queue_duration_s":2.265633,"scheduling_latency_s":2.265677,"redis_calls":13,"redis_duration_s":0.00243,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023078,"completed_at":"2026-10-17T23:59:06.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 162.353109] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5303fd72885f95fbb75f67f5","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5303fd72885f95fbb75f67f5: start","job_status":"start","queue_duration_s":2.324371,"scheduling_latency_s":2.324409}1390gitlab # [ 162.377682] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5303fd72885f95fbb75f67f5","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5303fd72885f95fbb75f67f5: done: 0.024675 sec","job_status":"done","queue_duration_s":2.324371,"scheduling_latency_s":2.324409,"redis_calls":13,"redis_duration_s":0.002496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024675,"completed_at":"2026-10-17T23:59:06.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 162.379607] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0010815529887455f3d4f988","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0010815529887455f3d4f988: start","job_status":"start","queue_duration_s":2.351257,"scheduling_latency_s":2.351277}1392gitlab # [ 162.434871] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0010815529887455f3d4f988","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0010815529887455f3d4f988: done: 0.054763 sec","job_status":"done","queue_duration_s":2.351257,"scheduling_latency_s":2.351277,"redis_calls":13,"redis_duration_s":0.040777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.040126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054763,"completed_at":"2026-10-17T23:59:06.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 162.470457] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7268fa5fdcc051727be9d15","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7268fa5fdcc051727be9d15: start","job_status":"start","queue_duration_s":2.441494,"scheduling_latency_s":2.441532}1394gitlab # [ 162.496089] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7268fa5fdcc051727be9d15","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7268fa5fdcc051727be9d15: done: 0.025695 sec","job_status":"done","queue_duration_s":2.441494,"scheduling_latency_s":2.441532,"redis_calls":13,"redis_duration_s":0.003323,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025695,"completed_at":"2026-10-17T23:59:06.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 162.532939] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0eae73ab6cecbe0126fdf2b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0eae73ab6cecbe0126fdf2b: start","job_status":"start","queue_duration_s":2.504179,"scheduling_latency_s":2.504221}1396gitlab # [ 162.558714] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0eae73ab6cecbe0126fdf2b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0eae73ab6cecbe0126fdf2b: done: 0.025669 sec","job_status":"done","queue_duration_s":2.504179,"scheduling_latency_s":2.504221,"redis_calls":13,"redis_duration_s":0.004051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025669,"completed_at":"2026-10-17T23:59:06.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 162.594630] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c09afdf22b7e4d431dd5730c","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c09afdf22b7e4d431dd5730c: start","job_status":"start","queue_duration_s":2.565947,"scheduling_latency_s":2.565986}1398gitlab # [ 162.625416] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c09afdf22b7e4d431dd5730c","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c09afdf22b7e4d431dd5730c: done: 0.030742 sec","job_status":"done","queue_duration_s":2.565947,"scheduling_latency_s":2.565986,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030742,"completed_at":"2026-10-17T23:59:06.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 162.661736] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208d88cfe45347b42a9ea027","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208d88cfe45347b42a9ea027: start","job_status":"start","queue_duration_s":2.633109,"scheduling_latency_s":2.633147}1400gitlab # [ 162.683624] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208d88cfe45347b42a9ea027","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208d88cfe45347b42a9ea027: done: 0.021773 sec","job_status":"done","queue_duration_s":2.633109,"scheduling_latency_s":2.633147,"redis_calls":13,"redis_duration_s":0.0025139999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001666,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021773,"completed_at":"2026-10-17T23:59:06.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 162.719765] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df6c4b1fdebcb26e5b9adcf","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df6c4b1fdebcb26e5b9adcf: start","job_status":"start","queue_duration_s":2.691235,"scheduling_latency_s":2.691263}1402gitlab # [ 162.733281] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df6c4b1fdebcb26e5b9adcf","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df6c4b1fdebcb26e5b9adcf: done: 0.013124 sec","job_status":"done","queue_duration_s":2.691235,"scheduling_latency_s":2.691263,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013124,"completed_at":"2026-10-17T23:59:06.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 162.768899] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7654b81e9d880b859617355","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7654b81e9d880b859617355: start","job_status":"start","queue_duration_s":2.740435,"scheduling_latency_s":2.740457}1404gitlab # [ 162.780666] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7654b81e9d880b859617355","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7654b81e9d880b859617355: done: 0.011628 sec","job_status":"done","queue_duration_s":2.740435,"scheduling_latency_s":2.740457,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011628,"completed_at":"2026-10-17T23:59:06.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 162.817832] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab7e22daa0341bbdafcf3b6e","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab7e22daa0341bbdafcf3b6e: start","job_status":"start","queue_duration_s":2.789111,"scheduling_latency_s":2.789157}1406gitlab # [ 162.840436] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab7e22daa0341bbdafcf3b6e","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab7e22daa0341bbdafcf3b6e: done: 0.02251 sec","job_status":"done","queue_duration_s":2.789111,"scheduling_latency_s":2.789157,"redis_calls":13,"redis_duration_s":0.002414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001594,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02251,"completed_at":"2026-10-17T23:59:06.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 162.876765] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e477a3c2ed426f275c527bff","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e477a3c2ed426f275c527bff: start","job_status":"start","queue_duration_s":2.848125,"scheduling_latency_s":2.848162}1408gitlab # [ 162.898372] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e477a3c2ed426f275c527bff","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e477a3c2ed426f275c527bff: done: 0.021396 sec","job_status":"done","queue_duration_s":2.848125,"scheduling_latency_s":2.848162,"redis_calls":13,"redis_duration_s":0.00241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001616,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021396,"completed_at":"2026-10-17T23:59:06.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 162.935937] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e30bfd255e508dff99cb2baf","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e30bfd255e508dff99cb2baf: start","job_status":"start","queue_duration_s":2.907352,"scheduling_latency_s":2.907381}1410gitlab # [ 162.948916] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e30bfd255e508dff99cb2baf","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e30bfd255e508dff99cb2baf: done: 0.012977 sec","job_status":"done","queue_duration_s":2.907352,"scheduling_latency_s":2.907381,"redis_calls":13,"redis_duration_s":0.002704,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012977,"completed_at":"2026-10-17T23:59:06.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 162.985748] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0662950e1b4c8aa0616efaac","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0662950e1b4c8aa0616efaac: start","job_status":"start","queue_duration_s":2.957012,"scheduling_latency_s":2.957045}1412gitlab # [ 163.038389] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0662950e1b4c8aa0616efaac","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0662950e1b4c8aa0616efaac: done: 0.052867 sec","job_status":"done","queue_duration_s":2.957012,"scheduling_latency_s":2.957045,"redis_calls":13,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052867,"completed_at":"2026-10-17T23:59:06.789Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 163.075538] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"468a81268d708731617bd38a","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-468a81268d708731617bd38a: start","job_status":"start","queue_duration_s":3.046776,"scheduling_latency_s":3.046821}1414gitlab # [ 163.097512] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"468a81268d708731617bd38a","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-468a81268d708731617bd38a: done: 0.022029 sec","job_status":"done","queue_duration_s":3.046776,"scheduling_latency_s":3.046821,"redis_calls":13,"redis_duration_s":0.002426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022029,"completed_at":"2026-10-17T23:59:06.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 163.133937] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e91cf5d3906b3c280bf229da","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e91cf5d3906b3c280bf229da: start","job_status":"start","queue_duration_s":3.105011,"scheduling_latency_s":3.105048}1416gitlab # [ 163.155033] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e91cf5d3906b3c280bf229da","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e91cf5d3906b3c280bf229da: done: 0.021306 sec","job_status":"done","queue_duration_s":3.105011,"scheduling_latency_s":3.105048,"redis_calls":13,"redis_duration_s":0.00224,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021306,"completed_at":"2026-10-17T23:59:06.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 163.193054] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5851d2ab6bfa63f384638ff2","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5851d2ab6bfa63f384638ff2: start","job_status":"start","queue_duration_s":3.163161,"scheduling_latency_s":3.164205}1418gitlab # [ 163.217119] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:06.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5851d2ab6bfa63f384638ff2","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5851d2ab6bfa63f384638ff2: done: 0.025179 sec","job_status":"done","queue_duration_s":3.163161,"scheduling_latency_s":3.164205,"redis_calls":13,"redis_duration_s":0.0038640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002522,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025179,"completed_at":"2026-10-17T23:59:06.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 163.253541] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2818312529a1601604952763","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2818312529a1601604952763: start","job_status":"start","queue_duration_s":3.224749,"scheduling_latency_s":3.224786}1420gitlab # [ 163.276690] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2818312529a1601604952763","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2818312529a1601604952763: done: 0.023138 sec","job_status":"done","queue_duration_s":3.224749,"scheduling_latency_s":3.224786,"redis_calls":13,"redis_duration_s":0.003777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002555,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023138,"completed_at":"2026-10-17T23:59:07.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 163.313491] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c2c58c4d7a8ea3e9e1931fc","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c2c58c4d7a8ea3e9e1931fc: start","job_status":"start","queue_duration_s":3.284609,"scheduling_latency_s":3.284655}1422gitlab # [ 163.344890] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c2c58c4d7a8ea3e9e1931fc","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c2c58c4d7a8ea3e9e1931fc: done: 0.031528 sec","job_status":"done","queue_duration_s":3.284609,"scheduling_latency_s":3.284655,"redis_calls":13,"redis_duration_s":0.002519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001657,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031528,"completed_at":"2026-10-17T23:59:07.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 163.382477] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de96f1f639d46dc59ff4d629","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de96f1f639d46dc59ff4d629: start","job_status":"start","queue_duration_s":3.353067,"scheduling_latency_s":3.353111}1424gitlab # [ 163.412188] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de96f1f639d46dc59ff4d629","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de96f1f639d46dc59ff4d629: done: 0.03038 sec","job_status":"done","queue_duration_s":3.353067,"scheduling_latency_s":3.353111,"redis_calls":13,"redis_duration_s":0.005254,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002708,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03038,"completed_at":"2026-10-17T23:59:07.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 163.447183] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ff0a99338419e2ee551d5d4","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ff0a99338419e2ee551d5d4: start","job_status":"start","queue_duration_s":3.386364,"scheduling_latency_s":3.386395}1426gitlab # [ 163.459178] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ff0a99338419e2ee551d5d4","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ff0a99338419e2ee551d5d4: done: 0.020935 sec","job_status":"done","queue_duration_s":3.386364,"scheduling_latency_s":3.386395,"redis_calls":13,"redis_duration_s":0.004234,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020935,"completed_at":"2026-10-17T23:59:07.187Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 163.480214] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"246ba4f16742a949ef27766c","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-246ba4f16742a949ef27766c: start","job_status":"start","queue_duration_s":3.408876,"scheduling_latency_s":3.408901}1428gitlab # [ 163.480969] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"246ba4f16742a949ef27766c","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-246ba4f16742a949ef27766c: done: 0.009693 sec","job_status":"done","queue_duration_s":3.408876,"scheduling_latency_s":3.408901,"redis_calls":13,"redis_duration_s":0.002027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001533,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009693,"completed_at":"2026-10-17T23:59:07.198Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 163.525550] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9a758efa7bf7661db43e58","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9a758efa7bf7661db43e58: start","job_status":"start","queue_duration_s":3.419335,"scheduling_latency_s":3.419348}1430gitlab # [ 163.526285] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9a758efa7bf7661db43e58","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9a758efa7bf7661db43e58: done: 0.009046 sec","job_status":"done","queue_duration_s":3.419335,"scheduling_latency_s":3.419348,"redis_calls":13,"redis_duration_s":0.0015090000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009046,"completed_at":"2026-10-17T23:59:07.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 163.546280] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d231872d69de9dbc08e90a63","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d231872d69de9dbc08e90a63: start","job_status":"start","queue_duration_s":3.429753,"scheduling_latency_s":3.429766}1432gitlab # [ 163.591195] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d231872d69de9dbc08e90a63","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d231872d69de9dbc08e90a63: done: 0.009301 sec","job_status":"done","queue_duration_s":3.429753,"scheduling_latency_s":3.429766,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009301,"completed_at":"2026-10-17T23:59:07.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 163.592163] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cec9cecd0a1bdab1053b5d","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cec9cecd0a1bdab1053b5d: start","job_status":"start","queue_duration_s":3.439863,"scheduling_latency_s":3.439876}1434gitlab # [ 163.636222] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cec9cecd0a1bdab1053b5d","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cec9cecd0a1bdab1053b5d: done: 0.009562 sec","job_status":"done","queue_duration_s":3.439863,"scheduling_latency_s":3.439876,"redis_calls":13,"redis_duration_s":0.001861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009562,"completed_at":"2026-10-17T23:59:07.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 163.637424] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e0f76f55fd7d9941cb33389","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e0f76f55fd7d9941cb33389: start","job_status":"start","queue_duration_s":3.450196,"scheduling_latency_s":3.450209}1436gitlab # [ 163.678571] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e0f76f55fd7d9941cb33389","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e0f76f55fd7d9941cb33389: done: 0.012974 sec","job_status":"done","queue_duration_s":3.450196,"scheduling_latency_s":3.450209,"redis_calls":13,"redis_duration_s":0.005242,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003662,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012974,"completed_at":"2026-10-17T23:59:07.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 163.681913] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1133ea06dcc1c1dc275ea35","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1133ea06dcc1c1dc275ea35: start","job_status":"start","queue_duration_s":3.463991,"scheduling_latency_s":3.464004}1438gitlab # [ 163.728556] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1133ea06dcc1c1dc275ea35","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1133ea06dcc1c1dc275ea35: done: 0.009772 sec","job_status":"done","queue_duration_s":3.463991,"scheduling_latency_s":3.464004,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-10-17T23:59:07.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 163.729670] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84958d6183d9ec1f527c8533","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84958d6183d9ec1f527c8533: start","job_status":"start","queue_duration_s":3.474556,"scheduling_latency_s":3.474568}1440gitlab # [ 163.770129] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84958d6183d9ec1f527c8533","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84958d6183d9ec1f527c8533: done: 0.009255 sec","job_status":"done","queue_duration_s":3.474556,"scheduling_latency_s":3.474568,"redis_calls":13,"redis_duration_s":0.001429,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009255,"completed_at":"2026-10-17T23:59:07.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 163.772597] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b85863974dff013cb8489b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b85863974dff013cb8489b: start","job_status":"start","queue_duration_s":3.484788,"scheduling_latency_s":3.484801}1442gitlab # [ 163.783760] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82b85863974dff013cb8489b","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82b85863974dff013cb8489b: done: 0.008947 sec","job_status":"done","queue_duration_s":3.484788,"scheduling_latency_s":3.484801,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008947,"completed_at":"2026-10-17T23:59:07.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 163.839276] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78ef192fb43d7da04e777208","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78ef192fb43d7da04e777208: start","job_status":"start","queue_duration_s":3.494958,"scheduling_latency_s":3.494971}1444gitlab # [ 163.839914] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78ef192fb43d7da04e777208","created_at":"2026-10-17T23:59:03.562Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-719a7d3c44734548","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0ce2e62b819aea6111e637cad16f3139","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:03.780Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78ef192fb43d7da04e777208: done: 0.009824 sec","job_status":"done","queue_duration_s":3.494958,"scheduling_latency_s":3.494971,"redis_calls":13,"redis_duration_s":0.002089,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009824,"completed_at":"2026-10-17T23:59:07.284Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 163.864525] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.285Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7812f798d01626e5af04ed13","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7812f798d01626e5af04ed13: start","job_status":"start","queue_duration_s":3.262279,"scheduling_latency_s":3.262292}1446gitlab # [ 163.875519] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.298Z","message":"No existing merge request to be cleaned up."}1447gitlab # [ 163.914086] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.306Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7812f798d01626e5af04ed13","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7812f798d01626e5af04ed13: done: 0.021344 sec","job_status":"done","queue_duration_s":3.262279,"scheduling_latency_s":3.262292,"redis_calls":13,"redis_duration_s":0.001661,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205893,"duration_s":0.021344,"completed_at":"2026-10-17T23:59:07.306Z","load_balancing_strategy":"primary","db_duration_s":0.007243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 163.915176] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.307Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"09b247ef87a6824bafed6369","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-09b247ef87a6824bafed6369: start","job_status":"start","queue_duration_s":3.284518,"scheduling_latency_s":3.284531}1449gitlab # [ 163.923043] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.314Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 163.924644] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.318Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"09b247ef87a6824bafed6369","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-09b247ef87a6824bafed6369: done: 0.011012 sec","job_status":"done","queue_duration_s":3.284518,"scheduling_latency_s":3.284531,"redis_calls":10,"redis_duration_s":0.001232,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011012,"completed_at":"2026-10-17T23:59:07.318Z","load_balancing_strategy":"primary","db_duration_s":0.000955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 163.987934] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.319Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fbd116b7f781c2be1d20d7aa","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fbd116b7f781c2be1d20d7aa: start","job_status":"start","queue_duration_s":3.296313,"scheduling_latency_s":3.296326}1452gitlab # [ 163.988602] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.325Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 163.989080] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.330Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fbd116b7f781c2be1d20d7aa","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fbd116b7f781c2be1d20d7aa: done: 0.010559 sec","job_status":"done","queue_duration_s":3.296313,"scheduling_latency_s":3.296326,"redis_calls":10,"redis_duration_s":0.0012469999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010559,"completed_at":"2026-10-17T23:59:07.330Z","load_balancing_strategy":"primary","db_duration_s":0.001031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 164.005059] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.331Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01eda3b542e272f6c3c63451","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01eda3b542e272f6c3c63451: start","job_status":"start","queue_duration_s":3.307681,"scheduling_latency_s":3.307694}1455gitlab # [ 164.016458] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.337Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 164.017723] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:07.341Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01eda3b542e272f6c3c63451","created_at":"2026-10-17T23:59:04.010Z","trace_propagation_headers":{"sentry-trace":"2150dd4f3b7d4abc9735e23b30ee2544-4a0a5eff9d5e46fc","baggage":"sentry-trace_id=2150dd4f3b7d4abc9735e23b30ee2544,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"42878a2e00869ff252858e4835304548","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:04.023Z","job_size_bytes":2,"pid":1580,"sidekiq_tid":"maf8","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01eda3b542e272f6c3c63451: done: 0.010413 sec","job_status":"done","queue_duration_s":3.307681,"scheduling_latency_s":3.307694,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010413,"completed_at":"2026-10-17T23:59:07.341Z","load_balancing_strategy":"primary","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 173.815409] postgres[2379]: [2379] ERROR: relation "table_without_models" does not exist1458gitlab # [ 173.818245] postgres[2379]: [2379] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1459gitlab # [ 177.124895] runuser[2179]: pam_unix(runuser:session): session closed for user gitlab1460gitlab # [ 177.127819] setup-gitlab-start[2157]: + systemctl restart gitlab-sidekiq.service1461gitlab # [ 177.143495] systemd[1]: Stopping gitlab-sidekiq.service...1462gitlab # [ 177.145279] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:20.895Z","message":"Shutting down"}1463gitlab # [ 177.145911] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:20.895Z","message":"Scheduler exiting..."}1464gitlab # [ 177.147044] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:20.896Z","message":"Terminating quiet threads for default capsule"}1465gitlab # [ 177.147784] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:20.896Z","message":"Scheduler exiting..."}1466gitlab # [ 177.646095] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:21.397Z","message":"Pausing to allow jobs to finish..."}1467gitlab # [ 179.148252] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:22.899Z","message":"Bye!"}1468gitlab # [ 179.160393] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-17T23:59:22.912Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1580,"worker_id":"sidekiq_0","memwd_rss_bytes":943529984,"retry":0}1469gitlab # [ 181.040787] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1470gitlab # [ 181.042376] systemd[1]: Stopped gitlab-sidekiq.service.1471gitlab # [ 181.043818] systemd[1]: gitlab-sidekiq.service: Consumed 54.708s CPU time over 1min 53.025s wall clock time, 959.4M memory peak, 4.4M read from disk.1472gitlab # [ 181.046074] systemd[1]: Started gitlab-sidekiq.service.1473gitlab # [ 181.048738] setup-gitlab-start[2157]: + mkdir -p /var/lib/secrets1474gitlab # [ 181.053064] setup-gitlab-start[2157]: + echo nixbot-test-token-of-20-chars1475gitlab # [ 181.055376] setup-gitlab-start[2157]: + chmod 644 /var/lib/secrets/gitlab-token1476gitlab # [ 181.057924] setup-gitlab-start[2157]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1477gitlab # [ 181.282159] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:25 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1881478gitlab # [ 181.758611] gitaly[906]: time="2026-10-17T23:59:25.509Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.509" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1479gitlab # [ 181.759792] gitaly[906]: time="2026-10-17T23:59:25.509Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.509" grpc.time_ms=0.222 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1480gitlab # [ 181.892951] gitaly[906]: time="2026-10-17T23:59:25.644Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.143" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.644" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 181.905366] gitaly[906]: time="2026-10-17T23:59:25.645Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.143" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.644" grpc.time_ms=0.334 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1482gitlab # [ 181.948672] gitaly[906]: time="2026-10-17T23:59:25.700Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM diskcache=c93e8eff-ffa9-451a-8390-43c2e96debbe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T23:59:35.154" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.655" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 181.958270] gitaly[906]: time="2026-10-17T23:59:25.700Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T23:59:35.154" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.655" grpc.time_ms=45.492 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 181.970481] gitaly[906]: time="2026-10-17T23:59:25.714Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.213" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.714" pid=906 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1485gitlab # [ 181.980209] gitaly[906]: time="2026-10-17T23:59:25.714Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.213" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.714" grpc.time_ms=0.714 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 181.981408] gitaly[906]: time="2026-10-17T23:59:25.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T23:59:35.219" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.719" grpc.time_ms=9.686 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 182.036419] gitaly[906]: time="2026-10-17T23:59:25.788Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.287" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.787" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 182.037229] gitaly[906]: time="2026-10-17T23:59:25.788Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.287" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.787" grpc.time_ms=0.456 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 182.096403] gitaly[906]: time="2026-10-17T23:59:25.848Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM diskcache=a11a3f63-8c22-4396-9c53-d91cea1f2bcd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T23:59:35.307" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.807" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 182.106065] gitaly[906]: time="2026-10-17T23:59:25.848Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-17T23:59:35.307" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.807" grpc.time_ms=40.607 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 182.118375] gitaly[906]: time="2026-10-17T23:59:25.859Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.859" pid=906 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1492gitlab # [ 182.119098] gitaly[906]: time="2026-10-17T23:59:25.860Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.859" grpc.time_ms=0.766 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 182.120561] gitaly[906]: time="2026-10-17T23:59:25.871Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T23:59:35.012" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.863" grpc.time_ms=8.558 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 182.141259] gitaly[906]: time="2026-10-17T23:59:25.892Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-17T23:59:35.042" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.892" grpc.time_ms=0.161 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 182.145291] gitaly[906]: time="2026-10-17T23:59:25.897Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-17T23:59:35.046" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:25.896" grpc.time_ms=0.246 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 182.582598] gitaly[906]: time="2026-10-17T23:59:26.334Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WNW19BW7MVAN5FSSJPVM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T23:59:36.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:26.328" grpc.time_ms=5.774 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 182.811330] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:26 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 15031498gitlab # [ 182.812574] setup-gitlab-start[2433]: {"id":1,"message":null,"error":null}1499gitlab # [ 184.056501] sidekiq-cluster[2421]: {"severity":"INFO","time":"2026-10-17T23:59:27.791Z","message":"Starting cluster with 1 processes"}1500gitlab # [ 187.912795] gitaly[906]: time="2026-10-17T23:59:31.663Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564WW7VAYAX7RN0HQ98DCCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T23:59:41.155" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:31.656" grpc.time_ms=7.634 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 187.955896] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:31 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1241502gitlab # [ 187.958680] setup-gitlab-start[2157]: + mkdir -p /tmp/test-flake1503gitlab # [ 187.960082] setup-gitlab-start[2157]: + cd /tmp/test-flake1504gitlab # [ 187.961138] setup-gitlab-start[2157]: + git init -b master1505gitlab # [ 187.981592] setup-gitlab-start[2506]: Initialized empty Git repository in /tmp/test-flake/.git/1506gitlab # [ 187.982631] setup-gitlab-start[2157]: + git config user.name test1507gitlab # [ 187.983935] setup-gitlab-start[2157]: + git config user.email test@example.com1508gitlab # [ 187.985942] setup-gitlab-start[2157]: + cat1509gitlab # [ 187.987833] setup-gitlab-start[2157]: + git add flake.nix1510gitlab # [ 187.990204] setup-gitlab-start[2157]: + git commit -m 'initial commit'1511gitlab # [ 188.004923] setup-gitlab-start[2511]: [master (root-commit) 3c897c5] initial commit1512gitlab # [ 188.005624] setup-gitlab-start[2511]: 1 file changed, 10 insertions(+)1513gitlab # [ 188.006051] setup-gitlab-start[2511]: create mode 100644 flake.nix1514gitlab # [ 188.006960] setup-gitlab-start[2157]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1515gitlab # [ 188.014261] setup-gitlab-start[2157]: + git push -u origin master1516gitlab # [ 188.053836] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:31 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 211517gitlab # [ 188.332761] gitaly[906]: time="2026-10-17T23:59:32.084Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWEZKJ8W66NSCSW9CGCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:32.077" grpc.time_ms=7.004 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1518gitlab # [ 188.344953] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:32 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2771519gitlab # [ 188.610923] gitaly[906]: time="2026-10-17T23:59:32.362Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T23:59:42.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:32.357" grpc.time_ms=5.052 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1520gitlab # [ 188.648813] gitaly[906]: time="2026-10-17T23:59:32.400Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-18T00:00:02.092" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-17T23:59:32.393" grpc.time_ms=6.698 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1521gitlab # [ 188.679736] gitaly[906]: time="2026-10-17T23:59:32.431Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M564WWR65GP1W8KQP57V4258 duration_ms=150ns method=POST pid=906 status=200 url="http://unix/api/v4/internal/allowed"1522gitlab # [ 188.723062] gitaly[906]: time="2026-10-17T23:59:32.474Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M564WWR65GP1W8KQP57V4258 duration_ms=39ns method=POST pid=906 status=200 url="http://unix/api/v4/internal/pre_receive"1523gitlab # [ 188.725939] gitaly[906]: time="2026-10-17T23:59:32.477Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:32.280" grpc.time_ms=197.615 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1524gitlab # [ 188.760610] gitaly[906]: time="2026-10-17T23:59:32.512Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:32.511" grpc.time_ms=0.788 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 188.796139] gitaly[906]: time="2026-10-17T23:59:32.546Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:32.545" grpc.time_ms=0.601 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1526gitlab # [ 188.821375] gitaly[906]: time="2026-10-17T23:59:32.573Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:32.572" grpc.time_ms=0.319 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1527gitlab # [ 188.927541] gitaly[906]: time="2026-10-17T23:59:32.679Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-17T23:59:42.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:32.674" grpc.time_ms=4.722 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 188.944488] gitaly[906]: time="2026-10-17T23:59:32.696Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-17T23:59:42.013" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:32.683" grpc.time_ms=12.474 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1529gitlab # [ 188.964485] gitaly[906]: time="2026-10-17T23:59:32.716Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M564WWR65GP1W8KQP57V4258 duration_ms=117ns method=POST pid=906 status=200 url="http://unix/api/v4/internal/post_receive"1530gitlab # [ 188.968462] gitaly[906]: time="2026-10-17T23:59:32.716Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:32.598" grpc.time_ms=117.857 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 188.978723] gitaly[906]: time="2026-10-17T23:59:32.728Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 diskcache=890572ab-d50d-4503-bfdb-649f9eca3a70 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:32.223" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 188.990123] gitlab-workhorse[826]: time="2026-10-17T23:59:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521533gitlab # [ 188.991990] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:32 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6261534gitlab # [ 188.994121] setup-gitlab-start[2515]: To http://gitlab/root/test-flake.git1535gitlab # [ 188.995039] setup-gitlab-start[2515]: * [new branch] master -> master1536gitlab # [ 188.995981] gitaly[906]: time="2026-10-17T23:59:32.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=164 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=868352 command.minflt=13924 command.oublock=32 command.real_time_ms=495 command.spawn_token_fork_ms=0 command.system_time_ms=104 command.user_time_ms=60 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:32.223" grpc.time_ms=504.598 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1537gitlab # [ 189.008554] setup-gitlab-start[2515]: branch 'master' set up to track 'origin/master'.1538gitlab # [ 189.011616] systemd[1]: Finished setup-gitlab.service.1539gitlab # [ 189.013964] systemd[1]: Starting nixbot CI service...1540gitlab # [ 189.971866] nixbot[2603]: {"ts": "2026-10-17T23:59:33.722Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1541gitlab # [ 190.004334] nixbot[2603]: {"ts": "2026-10-17T23:59:33.755Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1542gitlab # [ 190.030837] nixbot[2603]: {"ts": "2026-10-17T23:59:33.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1543gitlab # [ 190.040836] nixbot[2603]: {"ts": "2026-10-17T23:59:33.792Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1544gitlab # [ 190.048890] nixbot[2603]: {"ts": "2026-10-17T23:59:33.800Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1545gitlab # [ 190.061386] nixbot[2603]: {"ts": "2026-10-17T23:59:33.813Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1546gitlab # [ 190.068631] nixbot[2603]: {"ts": "2026-10-17T23:59:33.820Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1547gitlab # [ 190.075576] nixbot[2603]: {"ts": "2026-10-17T23:59:33.827Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1548gitlab # [ 190.083052] nixbot[2603]: {"ts": "2026-10-17T23:59:33.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1549gitlab: (finished: waiting for unit setup-gitlab.service, in 190.70 seconds)1550gitlab # [ 190.089975] nixbot[2603]: {"ts": "2026-10-17T23:59:33.841Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1551gitlab: waiting for unit nixbot.service1552gitlab # [ 190.100857] nixbot[2603]: {"ts": "2026-10-17T23:59:33.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1553gitlab # [ 190.110061] nixbot[2603]: {"ts": "2026-10-17T23:59:33.860Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1554gitlab # [ 190.112385] nixbot[2603]: {"ts": "2026-10-17T23:59:33.864Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1555gitlab # [ 190.113870] nixbot[2603]: {"ts": "2026-10-17T23:59:33.865Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1556gitlab # [ 190.116130] nixbot[2603]: {"ts": "2026-10-17T23:59:33.867Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1557gitlab # [ 190.118496] nixbot[2603]: {"ts": "2026-10-17T23:59:33.870Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1558gitlab # [ 190.121288] nixbot[2603]: {"ts": "2026-10-17T23:59:33.872Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1559gitlab # [ 190.123530] nixbot[2603]: {"ts": "2026-10-17T23:59:33.875Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1560gitlab # [ 190.128644] nixbot[2603]: {"ts": "2026-10-17T23:59:33.880Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1561gitlab # [ 190.130908] nixbot[2603]: {"ts": "2026-10-17T23:59:33.882Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1562gitlab # [ 190.132973] nixbot[2603]: {"ts": "2026-10-17T23:59:33.884Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1563gitlab # [ 190.138372] nixbot[2603]: {"ts": "2026-10-17T23:59:33.890Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1564gitlab # [ 190.140467] nixbot[2603]: {"ts": "2026-10-17T23:59:33.892Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1565gitlab # [ 190.143045] nixbot[2603]: {"ts": "2026-10-17T23:59:33.894Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1566gitlab # [ 190.145112] nixbot[2603]: {"ts": "2026-10-17T23:59:33.896Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1567gitlab # [ 190.148462] nixbot[2603]: {"ts": "2026-10-17T23:59:33.900Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1568gitlab # [ 190.150923] nixbot[2603]: {"ts": "2026-10-17T23:59:33.902Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1569gitlab # [ 190.152683] nixbot[2603]: {"ts": "2026-10-17T23:59:33.904Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1570gitlab # [ 190.154915] nixbot[2603]: {"ts": "2026-10-17T23:59:33.906Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1571gitlab # [ 190.164212] nixbot[2603]: {"ts": "2026-10-17T23:59:33.915Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1572gitlab # [ 190.167759] nixbot[2603]: {"ts": "2026-10-17T23:59:33.919Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1573gitlab # [ 190.171067] nixbot[2603]: {"ts": "2026-10-17T23:59:33.922Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1574gitlab # [ 190.174557] nixbot[2603]: {"ts": "2026-10-17T23:59:33.926Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1575gitlab # [ 190.179028] nixbot[2603]: {"ts": "2026-10-17T23:59:33.930Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1576gitlab # [ 190.182231] nixbot[2603]: {"ts": "2026-10-17T23:59:33.933Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1577gitlab # [ 190.187490] nixbot[2603]: {"ts": "2026-10-17T23:59:33.939Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1578gitlab # [ 190.191435] nixbot[2603]: {"ts": "2026-10-17T23:59:33.943Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1579gitlab # [ 190.195735] nixbot[2603]: {"ts": "2026-10-17T23:59:33.947Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1580gitlab # [ 190.463338] nixbot[2603]: {"ts": "2026-10-17T23:59:34.215Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2603]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1581gitlab # [ 190.464123] nixbot[2603]: {"ts": "2026-10-17T23:59:34.215Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1582gitlab # [ 190.481232] nixbot[2603]: {"ts": "2026-10-17T23:59:34.232Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:37390 - \"GET /health HTTP/1.1\" 200"}1583gitlab # [ 190.488242] systemd[1]: Started nixbot CI service.1584gitlab # [ 190.490042] systemd[1]: Reached target Multi-User System.1585gitlab # [ 190.494214] systemd[1]: Startup finished in 1.075s (kernel) + 3.345s (initrd) + 3min 6.072s (userspace) = 3min 10.494s.1586gitlab # [ 190.638820] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:34 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1561587gitlab # [ 190.668153] nixbot[2603]: {"ts": "2026-10-17T23:59:34.419Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1588gitlab # [ 190.774894] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 901589gitlab # [ 190.776836] nixbot[2603]: {"ts": "2026-10-17T23:59:34.528Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1590gitlab # [ 190.907280] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1221591gitlab: (finished: waiting for unit nixbot.service, in 1.08 seconds)1592gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1593gitlab # [ 191.208930] nixbot[2603]: {"ts": "2026-10-17T23:59:34.960Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:37406 - \"GET /health HTTP/1.1\" 200"}1594gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1595subtest: project discovered and webhook registered1596gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1597gitlab # [ 191.313302] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 751598gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1599(finished: subtest: project discovered and webhook registered, in 0.10 seconds)1600subtest: push delivers the webhook1601gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1602gitlab # [ 191.407570] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4871603gitlab # [ 191.446165] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 301604gitlab # [ 191.519904] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 681605gitlab # [ 191.570369] gitaly[906]: time="2026-10-17T23:59:35.321Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564WZVCXJC3R7519BDPPQSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-18T00:00:05.006" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:35.306" grpc.time_ms=14.987 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 191.581602] gitaly[906]: time="2026-10-17T23:59:35.333Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WZVCXJC3R7519BDPPQSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:05.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:35.332" grpc.time_ms=0.568 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 191.591056] gitaly[906]: time="2026-10-17T23:59:35.342Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WZVCXJC3R7519BDPPQSM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-17T23:59:45.006" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:35.336" grpc.time_ms=5.584 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 191.613609] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 881609gitlab # [ 191.677326] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 571610gitlab # [ 191.683389] nixbot[2603]: {"ts": "2026-10-17T23:59:35.435Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1611gitlab # [ 191.783697] gitaly[906]: time="2026-10-17T23:59:35.535Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564X0244P29W48CFQ8M5RD3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.525" grpc.time_ms=10.074 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1612gitlab # [ 191.787197] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421613gitlab # [ 191.908160] gitaly[906]: time="2026-10-17T23:59:35.659Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564X03J10VH5JQV0DF4J3VM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.650" pid=906 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1614gitlab # [ 191.911261] gitaly[906]: time="2026-10-17T23:59:35.662Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564X03J10VH5JQV0DF4J3VM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.650" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1615gitlab # [ 191.913286] gitaly[906]: time="2026-10-17T23:59:35.662Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564X03J10VH5JQV0DF4J3VM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.650" grpc.time_ms=12.295 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1616gitlab # [ 191.914241] gitlab-workhorse[826]: time="2026-10-17T23:59:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131617gitlab # [ 191.917085] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1241618gitlab # [ 192.025826] gitaly[906]: time="2026-10-17T23:59:35.777Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564X07J8CWJQ22M47KX8SH5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.765" pid=906 remote_ip="2001:db8:1::1" request_sha=997ac43c50138854711460ce61c201ec379a01df response_bytes=223 span.kind=server system=grpc1619gitlab # [ 192.027312] gitaly[906]: time="2026-10-17T23:59:35.778Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564X07J8CWJQ22M47KX8SH5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.765" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1620gitlab # [ 192.028365] gitaly[906]: time="2026-10-17T23:59:35.778Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564X07J8CWJQ22M47KX8SH5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.765" grpc.time_ms=13.559 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1621gitlab # [ 192.030115] gitlab-workhorse[826]: time="2026-10-17T23:59:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231622gitlab # [ 192.031859] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1131623gitlab # [ 192.138406] gitaly[906]: time="2026-10-17T23:59:35.890Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564X0DBENNVNE3YDG1Q719J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.882" grpc.time_ms=7.017 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1624gitlab # [ 192.139945] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 381625gitlab # [ 192.230365] gitaly[906]: time="2026-10-17T23:59:35.982Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564X0FEX09GH6GA1EMFGT25 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.975" pid=906 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1626gitlab # [ 192.232426] gitaly[906]: time="2026-10-17T23:59:35.982Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0FEX09GH6GA1EMFGT25 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.975" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1627gitlab # [ 192.279304] gitaly[906]: time="2026-10-17T23:59:36.031Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0FEX09GH6GA1EMFGT25 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:35.975" grpc.time_ms=55.147 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab # [ 192.294289] gitlab-workhorse[826]: time="2026-10-17T23:59:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671629gitlab # [ 192.294898] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:36 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1131630gitlab # [ 192.357200] gitaly[906]: time="2026-10-17T23:59:36.108Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564X0M30347T7G0K0RNJG16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:36.098" grpc.time_ms=9.931 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1631gitlab # [ 192.358240] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:36 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421632gitlab # [ 192.406662] gitaly[906]: time="2026-10-17T23:59:36.158Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564X0NFTTJY4KR73QE2WY2V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:36.148" pid=906 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1633gitlab # [ 192.407067] gitaly[906]: time="2026-10-17T23:59:36.158Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1156 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0NFTTJY4KR73QE2WY2V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:36.148" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1634gitlab # [ 192.439254] gitaly[906]: time="2026-10-17T23:59:36.190Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1156 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0NFTTJY4KR73QE2WY2V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:36.148" grpc.time_ms=41.789 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1635gitlab # [ 192.440037] gitlab-workhorse[826]: time="2026-10-17T23:59:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091636gitlab # [ 192.440761] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:36 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 801637gitlab # [ 192.524092] gitaly[906]: time="2026-10-17T23:59:36.274Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:06.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:36.273" grpc.time_ms=0.661 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 192.550858] gitaly[906]: time="2026-10-17T23:59:36.302Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-18T00:00:06.095" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:36.295" grpc.time_ms=6.575 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1639gitlab # [ 192.581211] gitaly[906]: time="2026-10-17T23:59:36.332Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T23:59:46.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:36.325" grpc.time_ms=6.835 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1640gitlab # [ 192.597145] gitaly[906]: time="2026-10-17T23:59:36.348Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T23:59:46.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:36.339" grpc.time_ms=9.023 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1641gitlab # [ 192.656931] gitaly[906]: time="2026-10-17T23:59:36.408Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-17T23:59:46.087" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:36.408" grpc.time_ms=0.21 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1642gitlab # [ 192.689311] gitaly[906]: time="2026-10-17T23:59:36.440Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-17T23:59:46.111" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:36.431" grpc.time_ms=9.353 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1643gitlab # [ 192.737733] gitaly[906]: time="2026-10-17T23:59:36.489Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:36.488" grpc.time_ms=0.406 pid=906 span.kind=server system=grpc1644gitlab # [ 192.776290] gitaly[906]: time="2026-10-17T23:59:36.528Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-17T23:59:36.527" grpc.time_ms=0.332 pid=906 span.kind=server system=grpc1645gitlab # [ 192.794329] gitaly[906]: time="2026-10-17T23:59:36.546Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW diskcache=9018fa19-236f-40ac-b0c3-fa24632cb318 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T23:59:46.135" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:36.456" pid=906 ref=refs/keep-around/3c897c50b6c8c5620c39865064f32a34c881b703 remote_ip="2001:db8:1::1" revision=3c897c50b6c8c5620c39865064f32a34c881b703 span.kind=server system=grpc username=root1646gitlab # [ 192.806338] gitaly[906]: time="2026-10-17T23:59:36.557Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=75 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5561 command.oublock=8 command.real_time_ms=83 command.spawn_token_fork_ms=0 command.system_time_ms=46 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-17T23:59:46.135" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-17T23:59:36.456" grpc.time_ms=89.992 pid=906 ref=refs/keep-around/3c897c50b6c8c5620c39865064f32a34c881b703 remote_ip="2001:db8:1::1" revision=3c897c50b6c8c5620c39865064f32a34c881b703 span.kind=server system=grpc username=root1647gitlab # [ 192.809857] gitaly[906]: time="2026-10-17T23:59:36.561Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:06.361" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:36.561" grpc.time_ms=0.262 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1648gitlab # [ 192.959525] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4851649gitlab # [ 192.967606] nixbot[2603]: {"ts": "2026-10-17T23:59:36.718Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-3c897c50b6c8-0"}1650gitlab # [ 193.082968] nixbot[2603]: {"ts": "2026-10-17T23:59:36.834Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3c897c50b6c8-0", "argv0": "bwrap"}1651gitlab # [ 193.155703] systemd[1]: Started Nix Daemon.1652gitlab # [ 193.199643] nix-daemon[2756]: accepted connection from pid 2751, user nixbot1653gitlab # [ 197.800598] nix-daemon[2756]: accepted connection from pid 2805, user nixbot1654gitlab # [ 197.812285] nix-daemon[2756]: accepted connection from pid 2751, user nixbot1655gitlab # [ 202.182949] nix-daemon[2756]: accepted connection from pid 2751, user nixbot1656gitlab # [ 202.275636] nix-daemon[2756]: accepted connection from pid 2847, user nixbot1657gitlab # [ 202.325716] gitaly[906]: time="2026-10-17T23:59:46.076Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564XAASZGCJ89HZKZT79702 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:16.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:46.075" grpc.time_ms=0.667 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 202.477817] gitaly[906]: time="2026-10-17T23:59:46.229Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564XAASZGCJ89HZKZT79702 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T23:59:56.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:46.219" grpc.time_ms=9.828 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 202.575677] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3171660gitlab # [ 202.615774] gitaly[906]: time="2026-10-17T23:59:46.367Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564XAMXZVQK4AGN47P777K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:16.166" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:46.366" grpc.time_ms=0.517 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 202.655282] gitaly[906]: time="2026-10-17T23:59:46.406Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564XAMXZVQK4AGN47P777K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-17T23:59:56.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:46.401" grpc.time_ms=4.697 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1662gitlab # [ 202.685370] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1031663gitlab # [ 206.918383] nix-daemon[2756]: accepted connection from pid 2915, user nixbot1664gitlab # [ 206.973393] gitaly[906]: time="2026-10-17T23:59:50.724Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564XEX1WWRFK15MR44DKC4X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:20.423" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-17T23:59:50.724" grpc.time_ms=0.507 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 206.998299] gitaly[906]: time="2026-10-17T23:59:50.750Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564XEX1WWRFK15MR44DKC4X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:00.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-17T23:59:50.745" grpc.time_ms=4.805 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1666gitlab # [ 207.054724] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1161667gitlab # [ 207.229640] nixbot[2603]: {"ts": "2026-10-17T23:59:50.980Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "3c897c50b6c8c5620c39865064f32a34c881b703", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1668gitlab # [ 207.291142] gitaly[906]: time="2026-10-17T23:59:51.042Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M564XF6XK7G4VJVK6BCARXN3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.036" grpc.time_ms=6.684 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1669gitlab # [ 207.291549] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 371670gitlab # [ 207.347979] gitaly[906]: time="2026-10-17T23:59:51.099Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564XF8NV5Z92FF8XTQAFW23 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.093" pid=906 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1671gitlab # [ 207.348378] gitaly[906]: time="2026-10-17T23:59:51.099Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564XF8NV5Z92FF8XTQAFW23 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.093" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1672gitlab # [ 207.348936] gitaly[906]: time="2026-10-17T23:59:51.100Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564XF8NV5Z92FF8XTQAFW23 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.093" grpc.time_ms=6.602 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1673gitlab # [ 207.349844] gitlab-workhorse[826]: time="2026-10-17T23:59:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671674gitlab # [ 207.350734] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 391675gitlab # [ 207.446170] gitaly[906]: time="2026-10-17T23:59:51.197Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564XFBR71FMC0XXA5VSEQNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.192" grpc.time_ms=4.995 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1676gitlab # [ 207.457913] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 481677gitlab # [ 207.501327] gitaly[906]: time="2026-10-17T23:59:51.252Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564XFDCMQ5PE82VQY22S33T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.246" pid=906 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1678gitlab # [ 207.502112] gitaly[906]: time="2026-10-17T23:59:51.252Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564XFDCMQ5PE82VQY22S33T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.246" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1679gitlab # [ 207.504269] gitaly[906]: time="2026-10-17T23:59:51.254Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564XFDCMQ5PE82VQY22S33T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-17T23:59:51.246" grpc.time_ms=7.788 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1680gitlab # [ 207.505224] gitlab-workhorse[826]: time="2026-10-17T23:59:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671681gitlab # [ 207.505644] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/17:23:59:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 421682gitlab # [ 208.362798] sidekiq-cluster[2478]: 2026-10-17T23:59:52.114Z pid=2478 tid=xs6 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2478, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433586176}1683gitlab # [ 208.527708] sidekiq-cluster[2478]: W, [2026-10-17T23:59:52.278963 #2478] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1684gitlab # [ 208.563629] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-17T23:59:52.315Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1685gitlab # [ 210.188854] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-17T23:59:53.939Z","message":"GitLab reliable fetch activated!"}1686gitlab # [ 210.190311] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-17T23:59:53.939Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1687gitlab # [ 216.401748] systemd[1]: Starting Logrotate Service...1688gitlab # [ 216.477219] systemd[1]: logrotate.service: Deactivated successfully.1689gitlab # [ 216.478272] systemd[1]: Finished Logrotate Service.1690gitlab # [ 228.606717] postgres[3148]: [3148] ERROR: relation "table_without_models" does not exist1691gitlab # [ 228.608360] postgres[3148]: [3148] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1692gitlab # [ 231.048792] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:14.800Z","message":"Booted Rails 7.2.3.1 application in production environment"}1693gitlab # [ 231.051442] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:14.803Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1694gitlab # [ 231.053317] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:14.803Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1695gitlab # [ 231.054975] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:14.803Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1696gitlab # [ 231.057129] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:14.805Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1697gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.23 seconds)1698gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1699gitlab # [ 231.621401] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 261700gitlab # [ 231.694337] gitaly[906]: time="2026-10-18T00:00:15.445Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564Y70FNT6N8SQF261461B5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:15.439" grpc.time_ms=6.039 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1701gitlab # [ 231.695122] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:15 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 204 "" "git/2.55.0" 701702gitlab # Enumerating objects: 5, done.1703gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1704gitlab # Delta compression using up to 4 threads1705gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1706gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1707gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1708gitlab # [ 231.865381] gitaly[906]: time="2026-10-18T00:00:15.617Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-18T00:00:45.411" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-18T00:00:15.611" grpc.time_ms=5.387 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 231.891074] gitaly[906]: time="2026-10-18T00:00:15.642Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M564Y73FQ3AH88558ZMXV0TM duration_ms=78ns method=POST pid=906 status=200 url="http://unix/api/v4/internal/allowed"1710gitlab # [ 231.910208] gitaly[906]: time="2026-10-18T00:00:15.661Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M564Y73FQ3AH88558ZMXV0TM duration_ms=16ns method=POST pid=906 status=200 url="http://unix/api/v4/internal/pre_receive"1711gitlab # [ 231.912895] gitaly[906]: time="2026-10-18T00:00:15.664Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:15.563" grpc.time_ms=98.532 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1712gitlab # [ 231.939527] gitaly[906]: time="2026-10-18T00:00:15.691Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:15.690" grpc.time_ms=0.439 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1713gitlab # [ 231.969739] gitaly[906]: time="2026-10-18T00:00:15.721Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:15.721" grpc.time_ms=0.349 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1714gitlab # [ 231.998310] gitaly[906]: time="2026-10-18T00:00:15.750Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:15.749" grpc.time_ms=0.361 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1715gitlab # [ 232.068393] gitaly[906]: time="2026-10-18T00:00:15.820Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M564Y73FQ3AH88558ZMXV0TM duration_ms=44ns method=POST pid=906 status=200 url="http://unix/api/v4/internal/post_receive"1716gitlab # [ 232.071334] gitaly[906]: time="2026-10-18T00:00:15.823Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:15.775" grpc.time_ms=47.963 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 232.089532] gitaly[906]: time="2026-10-18T00:00:15.841Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM diskcache=d8a3ed6a-5e34-4c04-b451-37563cb28e95 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:15.523" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1718gitlab # [ 232.090282] gitaly[906]: time="2026-10-18T00:00:15.841Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13458 command.oublock=32 command.real_time_ms=309 command.spawn_token_fork_ms=0 command.system_time_ms=83 command.user_time_ms=46 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:15.523" grpc.time_ms=318.138 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 232.090986] gitlab-workhorse[826]: time="2026-10-18T00:00:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521720gitlab # [ 232.091694] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:15 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 3691721gitlab # To http://gitlab/root/test-flake.git1722gitlab # 3c897c5..b43331a master -> master1723gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.57 seconds)1724gitlab: must succeed: git -C /tmp/test-flake rev-parse master1725gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1726gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1727gitlab # [ 232.184434] nixbot[2603]: {"ts": "2026-10-18T00:00:15.935Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:33136 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1728gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.06 seconds)1729gitlab # [ 232.340852] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.091Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"528dee31912faa8dc4e80a4a","created_at":"2026-10-17T23:59:25.741Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:25.772Z","job_size_bytes":2,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-528dee31912faa8dc4e80a4a: start","job_status":"start","queue_duration_s":50.318667,"scheduling_latency_s":50.318725}1730gitlab # [ 232.543895] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.295Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"528dee31912faa8dc4e80a4a","created_at":"2026-10-17T23:59:25.741Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:25.772Z","job_size_bytes":2,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-528dee31912faa8dc4e80a4a: done: 0.204003 sec","job_status":"done","queue_duration_s":50.318667,"scheduling_latency_s":50.318725,"redis_calls":25,"redis_duration_s":0.006568,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004067,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.088238031,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.204003,"completed_at":"2026-10-18T00:00:16.295Z","load_balancing_strategy":"primary","db_duration_s":0.057727,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1731gitlab # [ 232.546371] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.296Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f2556f6a5f3f202b7393555b","created_at":"2026-10-17T23:59:25.780Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:25.783Z","job_size_bytes":2,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f2556f6a5f3f202b7393555b: start","job_status":"start","queue_duration_s":50.512533,"scheduling_latency_s":50.512551}1732gitlab # [ 232.612422] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.360Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"f2556f6a5f3f202b7393555b","created_at":"2026-10-17T23:59:25.780Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:25.783Z","job_size_bytes":2,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-f2556f6a5f3f202b7393555b: done: 0.06377 sec","job_status":"done","queue_duration_s":50.512533,"scheduling_latency_s":50.512551,"redis_calls":14,"redis_duration_s":0.002079,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000417,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.049091434,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.06377,"completed_at":"2026-10-18T00:00:16.360Z","load_balancing_strategy":"primary","db_duration_s":0.012174,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1733gitlab # [ 232.625663] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"de08e4188a29578e7b5acb39","created_at":"2026-10-17T23:59:26.236Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:26.240Z","job_size_bytes":5,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-de08e4188a29578e7b5acb39: start","job_status":"start","queue_duration_s":50.120589,"scheduling_latency_s":50.120602}1734gitlab # [ 232.713414] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.464Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"de08e4188a29578e7b5acb39","created_at":"2026-10-17T23:59:26.236Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:26.240Z","job_size_bytes":5,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-de08e4188a29578e7b5acb39: done: 0.10354 sec","job_status":"done","queue_duration_s":50.120589,"scheduling_latency_s":50.120602,"redis_calls":12,"redis_duration_s":0.001592,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200025,"duration_s":0.10354,"completed_at":"2026-10-18T00:00:16.464Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012069,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1735gitlab # [ 232.754057] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.505Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"482573ad7eb7f8cfb4d759f1","created_at":"2026-10-17T23:59:26.260Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:26.263Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-482573ad7eb7f8cfb4d759f1: start","job_status":"start","queue_duration_s":50.241996,"scheduling_latency_s":50.242018}1736gitlab # [ 232.902303] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.653Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"482573ad7eb7f8cfb4d759f1","created_at":"2026-10-17T23:59:26.260Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:26.263Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-482573ad7eb7f8cfb4d759f1: done: 0.147548 sec","job_status":"done","queue_duration_s":50.241996,"scheduling_latency_s":50.242018,"redis_calls":11,"redis_duration_s":0.002545,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000356,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.119,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.119,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000580241,"duration_s":0.147548,"completed_at":"2026-10-18T00:00:16.653Z","load_balancing_strategy":"primary","db_duration_s":0.054854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1737gitlab # [ 232.905391] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.655Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"556e875de60d2aa570551a6b","created_at":"2026-10-17T23:59:26.265Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:26.269Z","job_size_bytes":89,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-556e875de60d2aa570551a6b: start","job_status":"start","queue_duration_s":50.386249,"scheduling_latency_s":50.386286}1738gitlab # [ 232.944064] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.695Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"556e875de60d2aa570551a6b","created_at":"2026-10-17T23:59:26.265Z","trace_propagation_headers":{"sentry-trace":"14ee88080f6841fcbeb2172984f754f7-ee06c3d32e214ff3","baggage":"sentry-trace_id=14ee88080f6841fcbeb2172984f754f7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WNW19BW7MVAN5FSSJPVM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:26.269Z","job_size_bytes":89,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-556e875de60d2aa570551a6b: done: 0.040274 sec","job_status":"done","queue_duration_s":50.386249,"scheduling_latency_s":50.386286,"redis_calls":11,"redis_duration_s":0.001784,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000578,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.040274,"completed_at":"2026-10-18T00:00:16.695Z","load_balancing_strategy":"primary","db_duration_s":0.003159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1739gitlab # [ 233.000938] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.696Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3c897c50b6c8c5620c39865064f32a34c881b703 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"81d4ef013a22dd76b4586578","created_at":"2026-10-17T23:59:32.628Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-4ff9e19109624730","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:32.649Z","job_size_bytes":185,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-81d4ef013a22dd76b4586578: start","job_status":"start","queue_duration_s":44.047381,"scheduling_latency_s":44.047397}1740gitlab # [ 233.006738] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:16.706Z","message":"changes: \"0000000000000000000000000000000000000000 3c897c50b6c8c5620c39865064f32a34c881b703 refs/heads/master\\n\""}1741gitlab # [ 233.009279] gitaly[906]: time="2026-10-18T00:00:16.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:26.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:16.723" grpc.time_ms=5.222 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 233.055861] gitaly[906]: time="2026-10-18T00:00:16.780Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-18T00:00:26.054" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:16.775" grpc.time_ms=4.931 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 233.065268] gitaly[906]: time="2026-10-18T00:00:16.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-18T00:00:26.089" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:16.809" grpc.time_ms=7.165 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 233.088121] gitaly[906]: time="2026-10-18T00:00:16.839Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:16.839" grpc.time_ms=0.232 pid=906 span.kind=server system=grpc1745gitlab # [ 233.114859] gitaly[906]: time="2026-10-18T00:00:16.866Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:16.866" grpc.time_ms=0.406 pid=906 span.kind=server system=grpc1746gitlab # [ 233.131906] gitaly[906]: time="2026-10-18T00:00:16.883Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 diskcache=9b1dbca7-e5c8-4876-8688-bf0819da87cc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-18T00:00:26.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:16.823" pid=906 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1747gitlab # [ 233.132951] gitaly[906]: time="2026-10-18T00:00:16.883Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4883 command.oublock=8 command.real_time_ms=54 command.spawn_token_fork_ms=0 command.system_time_ms=25 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-18T00:00:26.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:16.823" grpc.time_ms=60.687 pid=906 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1748gitlab # [ 233.152616] gitaly[906]: time="2026-10-18T00:00:16.903Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-18T00:00:26.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:16.903" grpc.time_ms=0.101 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749gitlab # [ 233.165437] gitaly[906]: time="2026-10-18T00:00:16.917Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-18T00:00:26.185" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:16.905" grpc.time_ms=11.152 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1751gitlab # [ 233.211286] nixbot[2603]: {"ts": "2026-10-18T00:00:16.962Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58432 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1752gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.03 seconds)1753gitlab # [ 233.222848] gitaly[906]: time="2026-10-18T00:00:16.974Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-18T00:00:46.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:16.971" grpc.time_ms=3.216 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 233.251453] gitaly[906]: time="2026-10-18T00:00:17.003Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-18T00:00:27.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:17.002" grpc.time_ms=0.158 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 233.258075] gitaly[906]: time="2026-10-18T00:00:17.009Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-18T00:00:27.004" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-18T00:00:17.004" grpc.time_ms=5.172 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 233.283406] gitaly[906]: time="2026-10-18T00:00:17.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:27.030" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:17.030" grpc.time_ms=4.424 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 233.292084] gitaly[906]: time="2026-10-18T00:00:17.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:27.038" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:17.038" grpc.time_ms=4.842 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 233.310231] gitaly[906]: time="2026-10-18T00:00:17.061Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-18T00:00:47.053" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:17.053" grpc.time_ms=7.941 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 233.630388] gitaly[906]: time="2026-10-18T00:00:17.382Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-18T00:00:27.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:17.381" grpc.time_ms=0.689 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 233.661910] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:17.412Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3c897c50b6c8c5620c39865064f32a34c881b703 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"81d4ef013a22dd76b4586578","created_at":"2026-10-17T23:59:32.628Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-4ff9e19109624730","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-17T23:59:32.649Z","job_size_bytes":185,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-81d4ef013a22dd76b4586578: done: 0.716096 sec","job_status":"done","queue_duration_s":44.047381,"scheduling_latency_s":44.047397,"gitaly_calls":13,"gitaly_duration_s":0.195656,"redis_calls":199,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.029268,"redis_read_bytes":2103,"redis_write_bytes":21834,"redis_cache_calls":15,"redis_cache_duration_s":0.002094,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.003578,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.000997,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00247,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.012032,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":47,"redis_shared_state_duration_s":0.008097,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2221,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.163,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.179,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.435017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000322108,"exclusive_lock_hold_duration_s":0.059858166,"duration_s":0.716096,"completed_at":"2026-10-18T00:00:17.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.079324,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1761gitlab # [ 233.712916] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:17.464Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"056c04c8c0e56f601e0ef9e2","created_at":"2026-10-17T23:59:36.588Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.594Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-056c04c8c0e56f601e0ef9e2: start","job_status":"start","queue_duration_s":40.869742,"scheduling_latency_s":40.869784}1762gitlab # [ 233.798806] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:17.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"056c04c8c0e56f601e0ef9e2","created_at":"2026-10-17T23:59:36.588Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.594Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-056c04c8c0e56f601e0ef9e2: done: 0.086288 sec","job_status":"done","queue_duration_s":40.869742,"scheduling_latency_s":40.869784,"redis_calls":16,"redis_duration_s":0.004485,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002285,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376584,"duration_s":0.086288,"completed_at":"2026-10-18T00:00:17.550Z","load_balancing_strategy":"primary","db_duration_s":0.011712,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1763gitlab # [ 233.864448] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:17.615Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"72bc5e5f0c2e6fd2eccd6a26","created_at":"2026-10-17T23:59:36.594Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.597Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-72bc5e5f0c2e6fd2eccd6a26: start","job_status":"start","queue_duration_s":41.017712,"scheduling_latency_s":41.017772}1764gitlab # [ 233.975191] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:17.726Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"72bc5e5f0c2e6fd2eccd6a26","created_at":"2026-10-17T23:59:36.594Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.597Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-72bc5e5f0c2e6fd2eccd6a26: done: 0.11128 sec","job_status":"done","queue_duration_s":41.017712,"scheduling_latency_s":41.017772,"redis_calls":21,"redis_duration_s":0.006045,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002786,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001562,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410387,"duration_s":0.11128,"completed_at":"2026-10-18T00:00:17.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765gitlab # [ 234.048568] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:17.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a4c9b3357cc34755ebb5250e","created_at":"2026-10-17T23:59:36.695Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.699Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a4c9b3357cc34755ebb5250e: start","job_status":"start","queue_duration_s":41.100444,"scheduling_latency_s":41.100472}1766gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1767gitlab # [ 234.251806] nixbot[2603]: {"ts": "2026-10-18T00:00:18.003Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58434 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1768gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.04 seconds)1769gitlab # [ 234.263783] gitaly[906]: time="2026-10-18T00:00:18.014Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:18.014" grpc.time_ms=0.3 pid=906 span.kind=server system=grpc1770gitlab # [ 234.310414] gitaly[906]: time="2026-10-18T00:00:18.062Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:18.061" grpc.time_ms=0.261 pid=906 span.kind=server system=grpc1771gitlab # [ 234.358410] gitaly[906]: time="2026-10-18T00:00:18.110Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:18.109" grpc.time_ms=0.678 pid=906 span.kind=server system=grpc1772gitlab # [ 234.380883] gitaly[906]: time="2026-10-18T00:00:18.132Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW diskcache=8db903f7-d045-402f-abd3-62c93f3ae249 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:47.077" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:17.977" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 234.384309] gitaly[906]: time="2026-10-18T00:00:18.132Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7243 command.oublock=0 command.real_time_ms=148 command.spawn_token_fork_ms=0 command.system_time_ms=65 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:47.077" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:17.977" grpc.time_ms=154.744 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 234.456779] gitaly[906]: time="2026-10-18T00:00:18.208Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:48.207" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.207" grpc.time_ms=0.84 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 234.486364] gitaly[906]: time="2026-10-18T00:00:18.238Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564X0S082469JH8P9KP8YBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:48.237" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.237" grpc.time_ms=0.579 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 234.514623] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.266Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a4c9b3357cc34755ebb5250e","created_at":"2026-10-17T23:59:36.695Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.699Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2478,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a4c9b3357cc34755ebb5250e: rescheduled"}1777gitlab # [ 234.521033] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.272Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a4c9b3357cc34755ebb5250e","created_at":"2026-10-17T23:59:36.695Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-91ac6e9cfefd46fa","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-17T23:59:36.699Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a4c9b3357cc34755ebb5250e: done: 0.472641 sec","job_status":"done","queue_duration_s":41.100444,"scheduling_latency_s":41.100472,"gitaly_calls":3,"gitaly_duration_s":0.180966,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.023067,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001279,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001385,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.007801,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003439,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004792,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000522,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000462,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002108,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212241,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.402338007,"duration_s":0.472641,"completed_at":"2026-10-18T00:00:18.272Z","load_balancing_strategy":"primary","db_duration_s":0.048299,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1778gitlab # [ 234.539830] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.273Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3c897c50b6c8c5620c39865064f32a34c881b703 b43331a192111173eaecebf518089ef9ff5cf59a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7466a7a0f6744085a6320ed3","created_at":"2026-10-18T00:00:15.801Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-215a88d29d624622","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-18T00:00:15.803Z","job_size_bytes":185,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7466a7a0f6744085a6320ed3: start","job_status":"start","queue_duration_s":2.470241,"scheduling_latency_s":2.470256}1779gitlab # [ 234.598702] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.350Z","message":"changes: \"3c897c50b6c8c5620c39865064f32a34c881b703 b43331a192111173eaecebf518089ef9ff5cf59a refs/heads/master\\n\""}1780gitlab # [ 234.621305] gitaly[906]: time="2026-10-18T00:00:18.372Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:28.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:18.364" grpc.time_ms=8.588 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab # [ 234.633220] gitaly[906]: time="2026-10-18T00:00:18.384Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-18T00:00:28.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:18.379" grpc.time_ms=5.047 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 234.638542] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.389Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ba2a5f4fefe6f75644c8362","created_at":"2026-10-18T00:00:18.387Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"be0d24c98ae27d4a602cd854","job_size_bytes":46,"pid":2478,"job_status":"deduplicated","message":"ProjectCacheWorker JID-0ba2a5f4fefe6f75644c8362: deduplicated: until executing","deduplication.type":"until executing"}1783gitlab # [ 234.663734] gitaly[906]: time="2026-10-18T00:00:18.415Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-18T00:00:28.046" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:18.406" grpc.time_ms=9.037 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 234.675781] gitaly[906]: time="2026-10-18T00:00:18.427Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-18T00:00:48.418" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.419" grpc.time_ms=8.202 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 234.689985] gitaly[906]: time="2026-10-18T00:00:18.441Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-18T00:00:28.078" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-18T00:00:18.438" grpc.time_ms=3.048 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 234.710188] gitaly[906]: time="2026-10-18T00:00:18.461Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:28.097" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:18.457" grpc.time_ms=4.184 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 234.780752] gitaly[906]: time="2026-10-18T00:00:18.532Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-18T00:00:28.171" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.531" grpc.time_ms=0.735 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 234.794204] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.545Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3c897c50b6c8c5620c39865064f32a34c881b703 b43331a192111173eaecebf518089ef9ff5cf59a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7466a7a0f6744085a6320ed3","created_at":"2026-10-18T00:00:15.801Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-215a88d29d624622","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-18T00:00:15.803Z","job_size_bytes":185,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7466a7a0f6744085a6320ed3: done: 0.271327 sec","job_status":"done","queue_duration_s":2.470241,"scheduling_latency_s":2.470256,"gitaly_calls":7,"gitaly_duration_s":0.065187,"redis_calls":111,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.08210200000000001,"redis_read_bytes":501,"redis_write_bytes":12030,"redis_cache_calls":9,"redis_cache_duration_s":0.001429,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000865,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.069914,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005158,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":45,"redis_shared_state_duration_s":0.004736,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2095,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00039614,"exclusive_lock_hold_duration_s":0.018510733,"duration_s":0.271327,"completed_at":"2026-10-18T00:00:18.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016996,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1789gitlab # [ 234.838073] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.546Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"be0d24c98ae27d4a602cd854","created_at":"2026-10-18T00:00:16.781Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:16.793Z","job_size_bytes":46,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-be0d24c98ae27d4a602cd854: start","job_status":"start","queue_duration_s":1.752891,"scheduling_latency_s":1.752909}1790gitlab # [ 234.838706] gitaly[906]: time="2026-10-18T00:00:18.580Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-18T06:00:18.577" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:18.578" grpc.time_ms=2.466 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 234.842600] gitaly[906]: time="2026-10-18T00:00:18.594Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-18T00:00:48.587" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.588" grpc.time_ms=6.122 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 234.867600] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.618Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"be0d24c98ae27d4a602cd854","created_at":"2026-10-18T00:00:16.781Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:16.793Z","job_size_bytes":46,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-be0d24c98ae27d4a602cd854: done: 0.071569 sec","job_status":"done","queue_duration_s":1.752891,"scheduling_latency_s":1.752909,"gitaly_calls":2,"gitaly_duration_s":0.011909,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004995,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000921,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000431,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001917,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000334959,"duration_s":0.071569,"completed_at":"2026-10-18T00:00:18.618Z","load_balancing_strategy":"primary","db_duration_s":0.007628,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1793gitlab # [ 234.908737] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.620Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5d8d95a5360dda3adf935393","created_at":"2026-10-18T00:00:16.804Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:16.807Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5d8d95a5360dda3adf935393: start","job_status":"start","queue_duration_s":1.81323,"scheduling_latency_s":1.813256}1794gitlab # [ 234.909251] gitaly[906]: time="2026-10-18T00:00:18.651Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 diskcache=b2a745a6-14d0-4907-a617-1317c642d58d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-18T06:00:18.634" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.634" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 234.909787] gitaly[906]: time="2026-10-18T00:00:18.651Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1286 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-18T06:00:18.634" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.634" grpc.time_ms=16.496 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 234.954973] gitaly[906]: time="2026-10-18T00:00:18.694Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-18T00:00:48.689" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.689" grpc.time_ms=4.5 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 234.955710] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.672Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5d8d95a5360dda3adf935393","created_at":"2026-10-18T00:00:16.804Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:16.807Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5d8d95a5360dda3adf935393: done: 0.052432 sec","job_status":"done","queue_duration_s":1.81323,"scheduling_latency_s":1.813256,"gitaly_calls":1,"gitaly_duration_s":0.017941,"redis_calls":15,"redis_duration_s":0.001864,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000354,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.038065732,"duration_s":0.052432,"completed_at":"2026-10-18T00:00:18.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1798gitlab # [ 235.003029] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.673Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"42acaf1340ff1b1d26f3c5af","created_at":"2026-10-18T00:00:16.898Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:16.900Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-42acaf1340ff1b1d26f3c5af: start","job_status":"start","queue_duration_s":1.773079,"scheduling_latency_s":1.773093}1799gitlab # [ 235.003794] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.699Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"42acaf1340ff1b1d26f3c5af","created_at":"2026-10-18T00:00:16.898Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:16.900Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-42acaf1340ff1b1d26f3c5af: done: 0.025373 sec","job_status":"done","queue_duration_s":1.773079,"scheduling_latency_s":1.773093,"gitaly_calls":1,"gitaly_duration_s":0.006051,"redis_calls":16,"redis_duration_s":0.0022,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000148,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000793,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025373,"completed_at":"2026-10-18T00:00:18.699Z","load_balancing_strategy":"primary","db_duration_s":0.001434,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1800gitlab # [ 235.045115] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:18.700Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4258d2573be7099cad8335eb","created_at":"2026-10-18T00:00:17.273Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7025911989c92b281e2d674a19c178b765ca735618ce7244b30225de2e725c67","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:17.276Z","job_size_bytes":467,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4258d2573be7099cad8335eb: start","job_status":"start","queue_duration_s":1.42347,"scheduling_latency_s":1.423484}1801gitlab # [ 235.046099] gitaly[906]: time="2026-10-18T00:00:18.715Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:48.715" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.715" grpc.time_ms=0.313 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 235.094744] gitaly[906]: time="2026-10-18T00:00:18.721Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-18T00:00:28.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:18.717" grpc.time_ms=4.015 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 235.095591] gitaly[906]: time="2026-10-18T00:00:18.787Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:48.785" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.787" grpc.time_ms=0.49 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 235.096249] gitaly[906]: time="2026-10-18T00:00:18.791Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=29 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-18T00:00:48.789" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:18.789" grpc.time_ms=1.228 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 235.096881] gitaly[906]: time="2026-10-18T00:00:18.840Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:28.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:18.836" grpc.time_ms=4.595 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1807gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.03 seconds)1808gitlab # [ 235.290726] nixbot[2603]: {"ts": "2026-10-18T00:00:19.041Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58436 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1809gitlab # [ 235.499826] gitaly[906]: time="2026-10-18T00:00:19.250Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-18T00:00:49.237" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:19.237" grpc.time_ms=13.227 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 235.518058] gitaly[906]: time="2026-10-18T00:00:19.269Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564WWR65GP1W8KQP57V4258 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-18T00:00:49.252" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:19.253" grpc.time_ms=15.925 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 235.561889] sidekiq-cluster[2478]: {"severity":"WARN","time":"2026-10-18T00:00:19.313Z","class":"CreatePipelineWorker","correlation_id":"01M564WWR65GP1W8KQP57V4258","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3c897c50b6c8c5620c39865064f32a34c881b703","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3c897c50b6c8c5620c39865064f32a34c881b703","ref":"refs/heads/master"},"retry":0}1812gitlab # [ 235.578812] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.329Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4258d2573be7099cad8335eb","created_at":"2026-10-18T00:00:17.273Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7025911989c92b281e2d674a19c178b765ca735618ce7244b30225de2e725c67","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:17.276Z","job_size_bytes":467,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4258d2573be7099cad8335eb: done: 0.629773 sec","job_status":"done","queue_duration_s":1.42347,"scheduling_latency_s":1.423484,"gitaly_calls":7,"gitaly_duration_s":0.051702,"redis_calls":51,"redis_duration_s":0.041316,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000431,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.002896,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001286,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.024325,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.501299,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202539,"duration_s":0.629773,"completed_at":"2026-10-18T00:00:19.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031632,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1813gitlab # [ 235.623472] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.374Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c08476bc-d730-46c5-8adf-546bc7c7c0c5\"}"],"class":"WebHookWorker","jid":"97278c0a7f2937dc1a87613e","created_at":"2026-10-18T00:00:17.362Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d3af6264ce1416cb14ccc94a594c5d115344737ac285b4078ce68e99b29024a7","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:17.366Z","job_size_bytes":1751,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-97278c0a7f2937dc1a87613e: start","job_status":"start","queue_duration_s":2.007833,"scheduling_latency_s":2.007857}1814gitlab # [ 235.756912] nixbot[2603]: {"ts": "2026-10-18T00:00:19.508Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "42f0bc6b-c996-457c-b9a2-4df6e3a6b272", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "3c897c50b6c8c5620c39865064f32a34c881b703", "pr": null}1815gitlab # [ 235.761142] nixbot[2603]: {"ts": "2026-10-18T00:00:19.512Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58452 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1816gitlab # [ 235.782991] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.534Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c08476bc-d730-46c5-8adf-546bc7c7c0c5\"}"],"class":"WebHookWorker","jid":"97278c0a7f2937dc1a87613e","created_at":"2026-10-18T00:00:17.362Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-91cead24aab64124","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d3af6264ce1416cb14ccc94a594c5d115344737ac285b4078ce68e99b29024a7","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:17.366Z","job_size_bytes":1751,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-97278c0a7f2937dc1a87613e: done: 0.15932 sec","job_status":"done","queue_duration_s":2.007833,"scheduling_latency_s":2.007857,"redis_calls":19,"redis_duration_s":0.003822,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000861,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00041,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001692,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.06596676399999524,"cpu_s":0.078317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042268,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.15932,"completed_at":"2026-10-18T00:00:19.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1817gitlab # [ 235.834556] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.585Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"66b46677b77d0ff4e8595236","created_at":"2026-10-18T00:00:17.968Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:17.971Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-66b46677b77d0ff4e8595236: start","job_status":"start","queue_duration_s":1.613992,"scheduling_latency_s":1.614032}1818gitlab # [ 235.862234] gitaly[906]: time="2026-10-18T00:00:19.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564YB2SW3WQ7VKA72PJYDDB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.606" grpc.time_ms=7.674 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1819gitlab # [ 235.875196] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 801820gitlab # [ 235.920638] gitaly[906]: time="2026-10-18T00:00:19.672Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YB5B6VV6SEMXK660B7MD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.666" pid=906 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1821gitlab # [ 235.921634] gitaly[906]: time="2026-10-18T00:00:19.672Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YB5B6VV6SEMXK660B7MD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.666" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1822gitlab # [ 235.922321] gitlab-workhorse[826]: time="2026-10-18T00:00:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671823gitlab # [ 235.922892] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 451824gitlab # [ 235.944565] gitaly[906]: time="2026-10-18T00:00:19.696Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YB5B6VV6SEMXK660B7MD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.666" grpc.time_ms=5.606 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825gitlab # [ 235.947996] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"66b46677b77d0ff4e8595236","created_at":"2026-10-18T00:00:17.968Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:17.971Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-66b46677b77d0ff4e8595236: done: 0.113997 sec","job_status":"done","queue_duration_s":1.613992,"scheduling_latency_s":1.614032,"redis_calls":10,"redis_duration_s":0.006097999999999999,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000411,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000361498,"duration_s":0.113997,"completed_at":"2026-10-18T00:00:19.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016316,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1826gitlab # [ 235.998143] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.749Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"afb76b39f4a38b241086db60","created_at":"2026-10-18T00:00:18.139Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.144Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-afb76b39f4a38b241086db60: start","job_status":"start","queue_duration_s":1.604954,"scheduling_latency_s":1.604994}1827gitlab # [ 236.038453] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.789Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"afb76b39f4a38b241086db60","created_at":"2026-10-18T00:00:18.139Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.144Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-afb76b39f4a38b241086db60: done: 0.040108 sec","job_status":"done","queue_duration_s":1.604954,"scheduling_latency_s":1.604994,"redis_calls":10,"redis_duration_s":0.002598,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000439162,"duration_s":0.040108,"completed_at":"2026-10-18T00:00:19.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # [ 236.080285] gitaly[906]: time="2026-10-18T00:00:19.831Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YB6YEHD446028VCC6WZT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.777" pid=906 remote_ip="2001:db8:1::1" request_sha=94ee2ccad4733bcc68b70f1e82e0ec00247e7295 response_bytes=337 span.kind=server system=grpc1829gitlab # [ 236.081361] gitaly[906]: time="2026-10-18T00:00:19.832Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1189 command.oublock=0 command.real_time_ms=52 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M564YB6YEHD446028VCC6WZT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.777" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 236.082171] gitaly[906]: time="2026-10-18T00:00:19.832Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1189 command.oublock=0 command.real_time_ms=52 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M564YB6YEHD446028VCC6WZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:19.777" grpc.time_ms=54.898 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1831gitlab # [ 236.083257] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.833Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1ed64cd0924709c7b1e6a909","created_at":"2026-10-18T00:00:18.155Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.159Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1ed64cd0924709c7b1e6a909: start","job_status":"start","queue_duration_s":1.673356,"scheduling_latency_s":1.673405}1832gitlab # [ 236.131177] gitlab-workhorse[826]: time="2026-10-18T00:00:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371833gitlab # [ 236.132214] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 2051834gitlab # [ 236.139336] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1ed64cd0924709c7b1e6a909","created_at":"2026-10-18T00:00:18.155Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.159Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1ed64cd0924709c7b1e6a909: done: 0.057453 sec","job_status":"done","queue_duration_s":1.673356,"scheduling_latency_s":1.673405,"redis_calls":10,"redis_duration_s":0.00309,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000704,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001118299,"duration_s":0.057453,"completed_at":"2026-10-18T00:00:19.890Z","load_balancing_strategy":"primary","db_duration_s":0.007072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 236.141279] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"991d3623cbe293cd43826e8b","created_at":"2026-10-18T00:00:18.167Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.170Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-991d3623cbe293cd43826e8b: start","job_status":"start","queue_duration_s":1.722004,"scheduling_latency_s":1.722022}1836gitlab # [ 236.169953] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"991d3623cbe293cd43826e8b","created_at":"2026-10-18T00:00:18.167Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.170Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-991d3623cbe293cd43826e8b: done: 0.02933 sec","job_status":"done","queue_duration_s":1.722004,"scheduling_latency_s":1.722022,"redis_calls":13,"redis_duration_s":0.00254,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000564,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000269029,"duration_s":0.02933,"completed_at":"2026-10-18T00:00:19.921Z","load_balancing_strategy":"primary","db_duration_s":0.005922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1837gitlab # [ 236.199281] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.922Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"04ba719ed3436eac7f66be0e","created_at":"2026-10-18T00:00:18.170Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.172Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-04ba719ed3436eac7f66be0e: start","job_status":"start","queue_duration_s":1.74973,"scheduling_latency_s":1.749746}1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1839gitlab # [ 236.214223] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.945Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"04ba719ed3436eac7f66be0e","created_at":"2026-10-18T00:00:18.170Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.172Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-04ba719ed3436eac7f66be0e: done: 0.022637 sec","job_status":"done","queue_duration_s":1.74973,"scheduling_latency_s":1.749746,"redis_calls":10,"redis_duration_s":0.001865,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000264838,"duration_s":0.022637,"completed_at":"2026-10-18T00:00:19.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840gitlab # [ 236.267710] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.946Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"eaebfe7e081a0256993e5de8","created_at":"2026-10-18T00:00:18.173Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.176Z","job_size_bytes":19,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-eaebfe7e081a0256993e5de8: start","job_status":"start","queue_duration_s":1.770224,"scheduling_latency_s":1.770236}1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.03 seconds)1842gitlab # [ 236.268987] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"eaebfe7e081a0256993e5de8","created_at":"2026-10-18T00:00:18.173Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.176Z","job_size_bytes":19,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-eaebfe7e081a0256993e5de8: done: 0.02084 sec","job_status":"done","queue_duration_s":1.770224,"scheduling_latency_s":1.770236,"redis_calls":11,"redis_duration_s":0.0022170000000000002,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245283,"duration_s":0.02084,"completed_at":"2026-10-18T00:00:19.967Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1843gitlab # [ 236.320333] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.968Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f5a708e79d64446f62b02f75","created_at":"2026-10-18T00:00:18.178Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.180Z","job_size_bytes":66,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f5a708e79d64446f62b02f75: start","job_status":"start","queue_duration_s":1.787646,"scheduling_latency_s":1.787658}1844gitlab # [ 236.324108] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.990Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f5a708e79d64446f62b02f75","created_at":"2026-10-18T00:00:18.178Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.180Z","job_size_bytes":66,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f5a708e79d64446f62b02f75: done: 0.021927 sec","job_status":"done","queue_duration_s":1.787646,"scheduling_latency_s":1.787658,"redis_calls":10,"redis_duration_s":0.0019399999999999999,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000369,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000403,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270984,"duration_s":0.021927,"completed_at":"2026-10-18T00:00:19.990Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1845gitlab # [ 236.364859] nixbot[2603]: {"ts": "2026-10-18T00:00:20.067Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58456 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1846gitlab # [ 236.366807] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:19.991Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b1ffea6ab8ae0a3a691a9909","created_at":"2026-10-18T00:00:18.181Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.183Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b1ffea6ab8ae0a3a691a9909: start","job_status":"start","queue_duration_s":1.807767,"scheduling_latency_s":1.807779}1847gitlab # [ 236.412693] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b1ffea6ab8ae0a3a691a9909","created_at":"2026-10-18T00:00:18.181Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.183Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b1ffea6ab8ae0a3a691a9909: done: 0.026046 sec","job_status":"done","queue_duration_s":1.807767,"scheduling_latency_s":1.807779,"redis_calls":10,"redis_duration_s":0.001966,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000376,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027266,"duration_s":0.026046,"completed_at":"2026-10-18T00:00:20.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848gitlab # [ 236.418850] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.018Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"fb332f321f4256e7bcbcca81","created_at":"2026-10-18T00:00:18.187Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.189Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-fb332f321f4256e7bcbcca81: start","job_status":"start","queue_duration_s":1.828965,"scheduling_latency_s":1.828977}1849gitlab # [ 236.432885] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.043Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"fb332f321f4256e7bcbcca81","created_at":"2026-10-18T00:00:18.187Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.189Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-fb332f321f4256e7bcbcca81: done: 0.02512 sec","job_status":"done","queue_duration_s":1.828965,"scheduling_latency_s":1.828977,"redis_calls":10,"redis_duration_s":0.001948,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000364,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000371,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276851,"duration_s":0.02512,"completed_at":"2026-10-18T00:00:20.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 236.506060] nixbot[2603]: {"ts": "2026-10-18T00:00:20.155Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1851gitlab # [ 236.506625] nixbot[2603]: {"ts": "2026-10-18T00:00:20.157Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "3c897c50b6c8c5620c39865064f32a34c881b703"}1852gitlab # [ 236.507596] gitaly[906]: time="2026-10-18T00:00:20.225Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM diskcache=a5d8bca8-2a73-47f0-b81b-e642b0669a18 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-18T06:00:20.207" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.208" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 236.508582] gitaly[906]: time="2026-10-18T00:00:20.226Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-18T06:00:20.207" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.208" grpc.time_ms=17.638 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 236.509639] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.044Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5fd7aa87a0ba23c11704f947","created_at":"2026-10-18T00:00:18.189Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.192Z","job_size_bytes":6,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5fd7aa87a0ba23c11704f947: start","job_status":"start","queue_duration_s":1.852499,"scheduling_latency_s":1.852513}1855gitlab # [ 236.510486] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5fd7aa87a0ba23c11704f947","created_at":"2026-10-18T00:00:18.189Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.192Z","job_size_bytes":6,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5fd7aa87a0ba23c11704f947: done: 0.017075 sec","job_status":"done","queue_duration_s":1.852499,"scheduling_latency_s":1.852513,"redis_calls":10,"redis_duration_s":0.002856,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000633,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000314565,"duration_s":0.017075,"completed_at":"2026-10-18T00:00:20.061Z","load_balancing_strategy":"primary","db_duration_s":0.00145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 236.553123] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"607ad62e8c0b8d55e94debe9","created_at":"2026-10-18T00:00:18.192Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.194Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-607ad62e8c0b8d55e94debe9: start","job_status":"start","queue_duration_s":1.86898,"scheduling_latency_s":1.868993}1857gitlab # [ 236.594230] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.121Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"607ad62e8c0b8d55e94debe9","created_at":"2026-10-18T00:00:18.192Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.194Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-607ad62e8c0b8d55e94debe9: done: 0.058141 sec","job_status":"done","queue_duration_s":1.86898,"scheduling_latency_s":1.868993,"redis_calls":10,"redis_duration_s":0.004786,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000530514,"duration_s":0.058141,"completed_at":"2026-10-18T00:00:20.121Z","load_balancing_strategy":"primary","db_duration_s":0.007498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 236.595667] gitaly[906]: time="2026-10-18T00:00:20.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:50.258" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.259" grpc.time_ms=9.074 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 236.639085] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.123Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"935bfa6194aa694555e07f14","created_at":"2026-10-18T00:00:18.197Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.200Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-935bfa6194aa694555e07f14: start","job_status":"start","queue_duration_s":1.922443,"scheduling_latency_s":1.922459}1860gitlab # [ 236.639705] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.171Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"935bfa6194aa694555e07f14","created_at":"2026-10-18T00:00:18.197Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.200Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-935bfa6194aa694555e07f14: done: 0.048201 sec","job_status":"done","queue_duration_s":1.922443,"scheduling_latency_s":1.922459,"redis_calls":14,"redis_duration_s":0.005178,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003902,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029892,"duration_s":0.048201,"completed_at":"2026-10-18T00:00:20.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 236.657777] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1801862gitlab # [ 236.659969] gitaly[906]: time="2026-10-18T00:00:20.299Z" level=info msg="finished unary call with code OK" catfile.duration_ms=47 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=47 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:50.249" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.250" grpc.time_ms=48.919 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 236.670691] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.172Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f09493d04736cce60f7fabe2","created_at":"2026-10-18T00:00:18.266Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.267Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f09493d04736cce60f7fabe2: start","job_status":"start","queue_duration_s":1.905126,"scheduling_latency_s":1.905143}1864gitlab # [ 236.712668] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.193Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f09493d04736cce60f7fabe2","created_at":"2026-10-18T00:00:18.266Z","trace_propagation_headers":{"sentry-trace":"750b841728d2429fafaf1883ee07f705-effc30c44c1c4f1e","baggage":"sentry-trace_id=750b841728d2429fafaf1883ee07f705,sentry-release=Unknown"},"correlation_id":"01M564X0S082469JH8P9KP8YBW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.267Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f09493d04736cce60f7fabe2: done: 0.021011 sec","job_status":"done","queue_duration_s":1.905126,"scheduling_latency_s":1.905143,"redis_calls":8,"redis_duration_s":0.001327,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021011,"completed_at":"2026-10-18T00:00:20.193Z","load_balancing_strategy":"primary","db_duration_s":0.003157,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1865gitlab # [ 236.719725] gitaly[906]: time="2026-10-18T00:00:20.309Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:30.092" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:20.302" grpc.time_ms=6.491 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 236.731441] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.194Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"10546268635c8981bc2ed1ad","created_at":"2026-10-18T00:00:18.398Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5d8d95a5360dda3adf935393","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.401Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-10546268635c8981bc2ed1ad: start","job_status":"start","queue_duration_s":1.793663,"scheduling_latency_s":1.793678}1867gitlab # [ 236.746061] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.235Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"10546268635c8981bc2ed1ad","created_at":"2026-10-18T00:00:18.398Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5d8d95a5360dda3adf935393","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.401Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-10546268635c8981bc2ed1ad: done: 0.040482 sec","job_status":"done","queue_duration_s":1.793663,"scheduling_latency_s":1.793678,"gitaly_calls":1,"gitaly_duration_s":0.019669,"redis_calls":12,"redis_duration_s":0.001786,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000447,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.027821692,"duration_s":0.040482,"completed_at":"2026-10-18T00:00:20.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1868gitlab # [ 236.804094] gitaly[906]: time="2026-10-18T00:00:20.310Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-18T00:00:30.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:20.302" grpc.time_ms=7.623 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 236.804953] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1391870gitlab # [ 236.805547] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.236Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4f48c7a3172c890e0108a4f0","created_at":"2026-10-18T00:00:18.497Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:28786da359e49267afb59811b7c78b0952e6ef7d83c1f7588f6ff5ae30cedd67","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.500Z","job_size_bytes":467,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4f48c7a3172c890e0108a4f0: start","job_status":"start","queue_duration_s":1.735585,"scheduling_latency_s":1.735599}1871gitlab # [ 236.815373] gitaly[906]: time="2026-10-18T00:00:20.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:50.031" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.331" grpc.time_ms=0.523 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 236.826578] gitaly[906]: time="2026-10-18T00:00:20.336Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=205 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-18T00:00:50.034" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.334" grpc.time_ms=2.395 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 236.869945] gitaly[906]: time="2026-10-18T00:00:20.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:30.060" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:20.360" grpc.time_ms=5.049 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 236.870641] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3c897c50b6c8c5620c39865064f32a34c881b703 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 961875gitlab # [ 236.871136] gitaly[906]: time="2026-10-18T00:00:20.396Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YBVZK1AK1Q2Z4VT2FQ9T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:50.195" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.395" grpc.time_ms=0.743 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 236.871801] gitaly[906]: time="2026-10-18T00:00:20.463Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564YBVZK1AK1Q2Z4VT2FQ9T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:30.137" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:20.457" grpc.time_ms=5.335 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 236.880476] gitaly[906]: time="2026-10-18T00:00:20.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YC0FF6FXHTTWJS45Y1E4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:50.233" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.533" grpc.time_ms=0.639 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 236.892257] gitaly[906]: time="2026-10-18T00:00:20.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YC0FF6FXHTTWJS45Y1E4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:30.222" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:20.552" grpc.time_ms=5.614 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 236.978192] gitaly[906]: time="2026-10-18T00:00:20.729Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564YC45AM948HNP6KJ6YDSE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.724" grpc.time_ms=5.775 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1880gitlab # [ 236.979221] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1161881gitlab # [ 237.013821] gitaly[906]: time="2026-10-18T00:00:20.765Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-18T00:00:50.457" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.757" grpc.time_ms=7.917 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 237.033432] gitaly[906]: time="2026-10-18T00:00:20.785Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YC7WARQG7T2FPAKF9KK6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.779" pid=906 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1883gitlab # [ 237.034627] gitaly[906]: time="2026-10-18T00:00:20.785Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YC7WARQG7T2FPAKF9KK6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.779" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1884gitlab # [ 237.035265] gitlab-workhorse[826]: time="2026-10-18T00:00:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671885gitlab # [ 237.035703] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 531886gitlab # [ 237.036191] gitaly[906]: time="2026-10-18T00:00:20.785Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YC7WARQG7T2FPAKF9KK6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.779" grpc.time_ms=5.888 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 237.073209] gitaly[906]: time="2026-10-18T00:00:20.824Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=37 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564Y73FQ3AH88558ZMXV0TM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-18T00:00:50.479" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:20.779" grpc.time_ms=45.38 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 237.082963] sidekiq-cluster[2478]: {"severity":"WARN","time":"2026-10-18T00:00:20.834Z","class":"CreatePipelineWorker","correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3c897c50b6c8c5620c39865064f32a34c881b703","after":"b43331a192111173eaecebf518089ef9ff5cf59a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"b43331a192111173eaecebf518089ef9ff5cf59a","ref":"refs/heads/master"},"retry":0}1889gitlab # [ 237.087975] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.839Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4f48c7a3172c890e0108a4f0","created_at":"2026-10-18T00:00:18.497Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:28786da359e49267afb59811b7c78b0952e6ef7d83c1f7588f6ff5ae30cedd67","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.500Z","job_size_bytes":467,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4f48c7a3172c890e0108a4f0: done: 0.602981 sec","job_status":"done","queue_duration_s":1.735585,"scheduling_latency_s":1.735599,"gitaly_calls":7,"gitaly_duration_s":0.141874,"redis_calls":33,"redis_duration_s":0.0043,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000386,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002631,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0006,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.436645,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.602981,"completed_at":"2026-10-18T00:00:20.839Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1890gitlab # [ 237.094225] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.840Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a44fec6e-f55d-454e-8e28-5d4abb6fd8be\"}"],"class":"WebHookWorker","jid":"2a79e4619d970d5652e1db8a","created_at":"2026-10-18T00:00:18.516Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11fdaaf87b5ab8f032acf60e68c2ad9ed2faf6860c65afc9656abd078b81c238","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.518Z","job_size_bytes":1749,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2a79e4619d970d5652e1db8a: start","job_status":"start","queue_duration_s":2.322186,"scheduling_latency_s":2.322203}1891gitlab # [ 237.133882] gitaly[906]: time="2026-10-18T00:00:20.844Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YCA2NAEN194J2FWVGRX8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.837" grpc.time_ms=7.005 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1892gitlab # [ 237.134736] gitaly[906]: time="2026-10-18T00:00:20.884Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YCBDZG5GXW3FEEXPY269 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.877" pid=906 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1893gitlab # [ 237.135452] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 411894gitlab # [ 237.135854] gitlab-workhorse[826]: time="2026-10-18T00:00:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671895gitlab # [ 237.136520] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 381896gitlab # [ 237.136963] nixbot[2603]: {"ts": "2026-10-18T00:00:20.858Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "3ff44411-6528-41b0-8ee3-b42f06b63ad8", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "b43331a192111173eaecebf518089ef9ff5cf59a", "pr": null}1897gitlab # [ 237.138715] nixbot[2603]: {"ts": "2026-10-18T00:00:20.860Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58466 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1898gitlab # [ 237.140689] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.868Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a44fec6e-f55d-454e-8e28-5d4abb6fd8be\"}"],"class":"WebHookWorker","jid":"2a79e4619d970d5652e1db8a","created_at":"2026-10-18T00:00:18.516Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-e05a1bbbf0914a17","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11fdaaf87b5ab8f032acf60e68c2ad9ed2faf6860c65afc9656abd078b81c238","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.518Z","job_size_bytes":1749,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2a79e4619d970d5652e1db8a: done: 0.027926 sec","job_status":"done","queue_duration_s":2.322186,"scheduling_latency_s":2.322203,"redis_calls":14,"redis_duration_s":0.003045,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000372,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004503087000017558,"cpu_s":0.015065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.027926,"completed_at":"2026-10-18T00:00:20.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 237.186259] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.869Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"bd20c6ffcf3b7f4e1210c218","created_at":"2026-10-18T00:00:18.603Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-8ca6ae9060354615","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.607Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-bd20c6ffcf3b7f4e1210c218: start","job_status":"start","queue_duration_s":2.262336,"scheduling_latency_s":2.262351}1900gitlab # [ 237.197621] gitaly[906]: time="2026-10-18T00:00:20.884Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCBDZG5GXW3FEEXPY269 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.877" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1901gitlab # [ 237.211086] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.906Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"bd20c6ffcf3b7f4e1210c218","created_at":"2026-10-18T00:00:18.603Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-8ca6ae9060354615","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:18.607Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-bd20c6ffcf3b7f4e1210c218: done: 0.036242 sec","job_status":"done","queue_duration_s":2.262336,"scheduling_latency_s":2.262351,"redis_calls":19,"redis_duration_s":0.008532,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001396,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000431,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003632,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003073,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009526070999999999,"duration_s":0.036242,"completed_at":"2026-10-18T00:00:20.905Z","load_balancing_strategy":"primary","db_duration_s":0.004242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1902gitlab # [ 237.262721] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.907Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","97278c0a7f2937dc1a87613e"],"class":"WebHooks::LogExecutionWorker","jid":"5ddffaf1c8e0d4362caacb26","created_at":"2026-10-18T00:00:19.517Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-64fb3050750b4303","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:76e4dc7026bc9bebfdaad6d3439482e84012b1a23817f78c0ad60b7dc7e37f90","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:19.523Z","job_size_bytes":2593,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5ddffaf1c8e0d4362caacb26: start","job_status":"start","queue_duration_s":1.383603,"scheduling_latency_s":1.383617}1903gitlab # [ 237.266314] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 381904gitlab # [ 237.267734] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 801905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1906gitlab # [ 237.268847] gitaly[906]: time="2026-10-18T00:00:20.884Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCBDZG5GXW3FEEXPY269 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.877" grpc.time_ms=6.967 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1907gitlab # [ 237.281684] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.937Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","97278c0a7f2937dc1a87613e"],"class":"WebHooks::LogExecutionWorker","jid":"5ddffaf1c8e0d4362caacb26","created_at":"2026-10-18T00:00:19.517Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-64fb3050750b4303","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:76e4dc7026bc9bebfdaad6d3439482e84012b1a23817f78c0ad60b7dc7e37f90","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:19.523Z","job_size_bytes":2593,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5ddffaf1c8e0d4362caacb26: done: 0.029924 sec","job_status":"done","queue_duration_s":1.383603,"scheduling_latency_s":1.383617,"redis_calls":10,"redis_duration_s":0.001824,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208127,"duration_s":0.029924,"completed_at":"2026-10-18T00:00:20.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.04 seconds)1909gitlab # [ 237.361295] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:20.938Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ba7ff74553907c69379dd795","created_at":"2026-10-18T00:00:20.332Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-4458921dcf9f4ac9","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.336Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ba7ff74553907c69379dd795: start","job_status":"start","queue_duration_s":0.60178,"scheduling_latency_s":0.601794}1910gitlab # [ 237.375993] gitlab-workhorse[826]: time="2026-10-18T00:00:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211911gitlab # [ 237.376681] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 691912gitlab # [ 237.377403] gitaly[906]: time="2026-10-18T00:00:20.956Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YCDNMXVY7NFM09P3Z8MA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.947" grpc.time_ms=9.026 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1913gitlab # [ 237.378291] nixbot[2603]: {"ts": "2026-10-18T00:00:21.107Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58482 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1914gitlab # [ 237.378817] gitaly[906]: time="2026-10-18T00:00:20.994Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=21 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M564YCDHPV1H4BK71RV2A0K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:20.963" grpc.time_ms=30.571 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915gitlab # [ 237.379488] gitaly[906]: time="2026-10-18T00:00:21.026Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YCEY5MBD30QJB5TSS3AM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:21.014" pid=906 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1916gitlab # [ 237.380113] gitaly[906]: time="2026-10-18T00:00:21.026Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCEY5MBD30QJB5TSS3AM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:21.014" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1917gitlab # [ 237.386952] gitlab-workhorse[826]: time="2026-10-18T00:00:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671918gitlab # [ 237.388630] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1351919gitlab # [ 237.390425] gitaly[906]: time="2026-10-18T00:00:21.027Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCEY5MBD30QJB5TSS3AM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:21.014" grpc.time_ms=12.244 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab # [ 237.434742] gitaly[906]: time="2026-10-18T00:00:21.092Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:21.089" grpc.time_ms=2.331 pid=906 span.kind=server system=grpc1921gitlab # [ 237.435540] gitaly[906]: time="2026-10-18T00:00:21.112Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:21.112" grpc.time_ms=0.295 pid=906 span.kind=server system=grpc1922gitlab # [ 237.436151] gitaly[906]: time="2026-10-18T00:00:21.131Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YCG4EGM8PHXDWKZ1EPFS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:21.122" pid=906 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1923gitlab # [ 237.436612] gitaly[906]: time="2026-10-18T00:00:21.131Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCG4EGM8PHXDWKZ1EPFS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:21.122" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1924gitlab # [ 237.441679] gitaly[906]: time="2026-10-18T00:00:21.131Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCG4EGM8PHXDWKZ1EPFS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:21.122" grpc.time_ms=8.756 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 237.498964] gitaly[906]: time="2026-10-18T00:00:21.250Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:21.250" grpc.time_ms=0.303 pid=906 span.kind=server system=grpc1926gitlab # [ 237.515684] gitaly[906]: time="2026-10-18T00:00:21.267Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN diskcache=6538a80e-cb95-4211-8044-27d1711cac83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:51.100" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:21.001" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 237.517261] gitaly[906]: time="2026-10-18T00:00:21.267Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=187 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=827392 command.minflt=7152 command.oublock=0 command.real_time_ms=260 command.spawn_token_fork_ms=2 command.system_time_ms=165 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:51.100" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:21.001" grpc.time_ms=266.176 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 237.528337] gitaly[906]: time="2026-10-18T00:00:21.280Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:51.279" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:21.279" grpc.time_ms=0.435 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 237.539254] gitaly[906]: time="2026-10-18T00:00:21.290Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-18T00:00:51.284" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:21.285" grpc.time_ms=5.055 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 237.548792] gitaly[906]: time="2026-10-18T00:00:21.300Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:31.085" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:21.295" grpc.time_ms=4.464 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 237.552600] gitaly[906]: time="2026-10-18T00:00:21.304Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:51.403" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:21.303" grpc.time_ms=0.396 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 237.570269] gitaly[906]: time="2026-10-18T00:00:21.322Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-18T00:00:31.111" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:21.321" grpc.time_ms=0.217 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 237.578447] gitaly[906]: time="2026-10-18T00:00:21.330Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-18T00:00:31.115" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:21.325" grpc.time_ms=4.149 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 237.602857] gitaly[906]: time="2026-10-18T00:00:21.354Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:21.354" grpc.time_ms=0.247 pid=906 span.kind=server system=grpc1935gitlab # [ 237.620122] gitaly[906]: time="2026-10-18T00:00:21.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:21.371" grpc.time_ms=0.315 pid=906 span.kind=server system=grpc1936gitlab # [ 237.636433] gitaly[906]: time="2026-10-18T00:00:21.388Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA diskcache=59e8ce48-017e-4db7-a50d-0dac6e91630c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-18T00:00:31.121" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:21.331" pid=906 ref=refs/keep-around/b43331a192111173eaecebf518089ef9ff5cf59a remote_ip="2001:db8:1::1" revision=b43331a192111173eaecebf518089ef9ff5cf59a span.kind=server system=grpc username=root1937gitlab # [ 237.637225] gitaly[906]: time="2026-10-18T00:00:21.388Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5361 command.oublock=8 command.real_time_ms=50 command.spawn_token_fork_ms=0 command.system_time_ms=23 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-18T00:00:31.121" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-18T00:00:21.331" grpc.time_ms=56.881 pid=906 ref=refs/keep-around/b43331a192111173eaecebf518089ef9ff5cf59a remote_ip="2001:db8:1::1" revision=b43331a192111173eaecebf518089ef9ff5cf59a span.kind=server system=grpc username=root1938gitlab # [ 237.642643] gitaly[906]: time="2026-10-18T00:00:21.394Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:51.091" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:21.391" grpc.time_ms=2.516 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 237.672369] gitaly[906]: time="2026-10-18T00:00:21.424Z" level=info msg="finished unary call with code OK" catfile.duration_ms=35 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=35 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YBP6G7SJBNK1B0B9P3GN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:51.487" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:21.387" grpc.time_ms=36.04 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 237.691759] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.443Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ba7ff74553907c69379dd795","created_at":"2026-10-18T00:00:20.332Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-4458921dcf9f4ac9","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.336Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2478,"job_status":"rescheduled","message":"PipelineProcessWorker JID-ba7ff74553907c69379dd795: rescheduled"}1941gitlab # [ 237.696529] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.448Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ba7ff74553907c69379dd795","created_at":"2026-10-18T00:00:20.332Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-4458921dcf9f4ac9","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.336Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ba7ff74553907c69379dd795: done: 0.509864 sec","job_status":"done","queue_duration_s":0.60178,"scheduling_latency_s":0.601794,"gitaly_calls":3,"gitaly_duration_s":0.38058,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011116,"redis_read_bytes":148,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000392,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000578,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002584,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003149,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000144,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000722,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003155,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085674,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.477835312,"duration_s":0.509864,"completed_at":"2026-10-18T00:00:21.448Z","load_balancing_strategy":"primary","db_duration_s":0.035342,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1942gitlab # [ 237.742533] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.449Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2a79e4619d970d5652e1db8a"],"class":"WebHooks::LogExecutionWorker","jid":"7a3726783cc2cef0d1475592","created_at":"2026-10-18T00:00:20.861Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-6c6e8178cb6d4328","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc9d27e726be2241b6f7e15f546c3df3b8f9dd4c42a8c0e5d114d866e08bd978","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.863Z","job_size_bytes":2592,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7a3726783cc2cef0d1475592: start","job_status":"start","queue_duration_s":0.585254,"scheduling_latency_s":0.585272}1943gitlab # [ 237.743191] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.466Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2a79e4619d970d5652e1db8a"],"class":"WebHooks::LogExecutionWorker","jid":"7a3726783cc2cef0d1475592","created_at":"2026-10-18T00:00:20.861Z","trace_propagation_headers":{"sentry-trace":"f24898972ee040329fee691fb61c56f2-6c6e8178cb6d4328","baggage":"sentry-trace_id=f24898972ee040329fee691fb61c56f2,sentry-release=Unknown"},"correlation_id":"01M564Y73FQ3AH88558ZMXV0TM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc9d27e726be2241b6f7e15f546c3df3b8f9dd4c42a8c0e5d114d866e08bd978","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.863Z","job_size_bytes":2592,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7a3726783cc2cef0d1475592: done: 0.0177 sec","job_status":"done","queue_duration_s":0.585254,"scheduling_latency_s":0.585272,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0177,"completed_at":"2026-10-18T00:00:21.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944gitlab # [ 237.788848] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0a96e2e2c508440d9c927706","created_at":"2026-10-18T00:00:20.892Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-10cf1c15aa864bde","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.900Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0a96e2e2c508440d9c927706: start","job_status":"start","queue_duration_s":0.567868,"scheduling_latency_s":0.567886}1945gitlab # [ 237.789732] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.520Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0a96e2e2c508440d9c927706","created_at":"2026-10-18T00:00:20.892Z","trace_propagation_headers":{"sentry-trace":"c97e57550b334a7d8e6bf5ef7b65cafe-10cf1c15aa864bde","baggage":"sentry-trace_id=c97e57550b334a7d8e6bf5ef7b65cafe,sentry-release=Unknown"},"correlation_id":"01M564WWR65GP1W8KQP57V4258","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.900Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0a96e2e2c508440d9c927706: done: 0.052976 sec","job_status":"done","queue_duration_s":0.567868,"scheduling_latency_s":0.567886,"redis_calls":11,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000211759,"duration_s":0.052976,"completed_at":"2026-10-18T00:00:21.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1946gitlab # [ 237.829850] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"415651a3a6cb8589c9164362","created_at":"2026-10-18T00:00:20.995Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.996Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-415651a3a6cb8589c9164362: start","job_status":"start","queue_duration_s":0.524903,"scheduling_latency_s":0.524917}1947gitlab # [ 237.832955] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"415651a3a6cb8589c9164362","created_at":"2026-10-18T00:00:20.995Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:20.996Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-415651a3a6cb8589c9164362: done: 0.023713 sec","job_status":"done","queue_duration_s":0.524903,"scheduling_latency_s":0.524917,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023713,"completed_at":"2026-10-18T00:00:21.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004582,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1948gitlab # [ 237.878871] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.546Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"49c0d06915c0d877cb4e4660","created_at":"2026-10-18T00:00:21.271Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.273Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-49c0d06915c0d877cb4e4660: start","job_status":"start","queue_duration_s":0.272473,"scheduling_latency_s":0.272486}1949gitlab # [ 237.885750] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.564Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"49c0d06915c0d877cb4e4660","created_at":"2026-10-18T00:00:21.271Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.273Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-49c0d06915c0d877cb4e4660: done: 0.017725 sec","job_status":"done","queue_duration_s":0.272473,"scheduling_latency_s":0.272486,"redis_calls":7,"redis_duration_s":0.00108,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017725,"completed_at":"2026-10-18T00:00:21.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1950gitlab # [ 237.935627] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.564Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5ab7d56be70d5ebc72df5afb","created_at":"2026-10-18T00:00:21.278Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.280Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5ab7d56be70d5ebc72df5afb: start","job_status":"start","queue_duration_s":0.284681,"scheduling_latency_s":0.284695}1951gitlab # [ 237.938746] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.583Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5ab7d56be70d5ebc72df5afb","created_at":"2026-10-18T00:00:21.278Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.280Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5ab7d56be70d5ebc72df5afb: done: 0.01841 sec","job_status":"done","queue_duration_s":0.284681,"scheduling_latency_s":0.284695,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01841,"completed_at":"2026-10-18T00:00:21.583Z","load_balancing_strategy":"primary","db_duration_s":0.005082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1952gitlab # [ 237.990440] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.584Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"62d643588e40603c073d0ebf","created_at":"2026-10-18T00:00:21.285Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.287Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-62d643588e40603c073d0ebf: start","job_status":"start","queue_duration_s":0.296665,"scheduling_latency_s":0.296678}1953gitlab # [ 237.991514] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"62d643588e40603c073d0ebf","created_at":"2026-10-18T00:00:21.285Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.287Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-62d643588e40603c073d0ebf: done: 0.016989 sec","job_status":"done","queue_duration_s":0.296665,"scheduling_latency_s":0.296678,"redis_calls":10,"redis_duration_s":0.001268,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000344,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016989,"completed_at":"2026-10-18T00:00:21.601Z","load_balancing_strategy":"primary","db_duration_s":0.002589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab # [ 238.045125] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.602Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"30fc53c4f776079692ca06a0","created_at":"2026-10-18T00:00:21.288Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.289Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-30fc53c4f776079692ca06a0: start","job_status":"start","queue_duration_s":0.312365,"scheduling_latency_s":0.312379}1955gitlab # [ 238.046094] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"30fc53c4f776079692ca06a0","created_at":"2026-10-18T00:00:21.288Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.289Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-30fc53c4f776079692ca06a0: done: 0.014095 sec","job_status":"done","queue_duration_s":0.312365,"scheduling_latency_s":0.312379,"redis_calls":7,"redis_duration_s":0.000873,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000222,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014095,"completed_at":"2026-10-18T00:00:21.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 238.096434] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"032c22482f3919c29a69cf76","created_at":"2026-10-18T00:00:21.289Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.291Z","job_size_bytes":19,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-032c22482f3919c29a69cf76: start","job_status":"start","queue_duration_s":0.32526,"scheduling_latency_s":0.325273}1957gitlab # [ 238.097609] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"032c22482f3919c29a69cf76","created_at":"2026-10-18T00:00:21.289Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.291Z","job_size_bytes":19,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-032c22482f3919c29a69cf76: done: 0.013368 sec","job_status":"done","queue_duration_s":0.32526,"scheduling_latency_s":0.325273,"redis_calls":8,"redis_duration_s":0.0009660000000000001,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013368,"completed_at":"2026-10-18T00:00:21.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1958gitlab # [ 238.157142] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.631Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"09794d4bd0af626e924874a8","created_at":"2026-10-18T00:00:21.292Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.293Z","job_size_bytes":66,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-09794d4bd0af626e924874a8: start","job_status":"start","queue_duration_s":0.33764,"scheduling_latency_s":0.337653}1959gitlab # [ 238.158147] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.643Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"09794d4bd0af626e924874a8","created_at":"2026-10-18T00:00:21.292Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.293Z","job_size_bytes":66,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-09794d4bd0af626e924874a8: done: 0.012444 sec","job_status":"done","queue_duration_s":0.33764,"scheduling_latency_s":0.337653,"redis_calls":7,"redis_duration_s":0.0008439999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012444,"completed_at":"2026-10-18T00:00:21.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1960gitlab # [ 238.217855] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.644Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"80b9e9ce716a6cf69759ddd5","created_at":"2026-10-18T00:00:21.293Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.294Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-80b9e9ce716a6cf69759ddd5: start","job_status":"start","queue_duration_s":0.349629,"scheduling_latency_s":0.349642}1961gitlab # [ 238.218846] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.659Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"80b9e9ce716a6cf69759ddd5","created_at":"2026-10-18T00:00:21.293Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.294Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-80b9e9ce716a6cf69759ddd5: done: 0.015058 sec","job_status":"done","queue_duration_s":0.349629,"scheduling_latency_s":0.349642,"redis_calls":7,"redis_duration_s":0.000876,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015058,"completed_at":"2026-10-18T00:00:21.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1962gitlab # [ 238.246396] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1715f0359e7f74381f94b89f","created_at":"2026-10-18T00:00:21.295Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.295Z","job_size_bytes":6,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1715f0359e7f74381f94b89f: start","job_status":"start","queue_duration_s":0.364461,"scheduling_latency_s":0.364474}1963gitlab # [ 238.285411] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.668Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1715f0359e7f74381f94b89f","created_at":"2026-10-18T00:00:21.295Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.295Z","job_size_bytes":6,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1715f0359e7f74381f94b89f: done: 0.00814 sec","job_status":"done","queue_duration_s":0.364461,"scheduling_latency_s":0.364474,"redis_calls":7,"redis_duration_s":0.001015,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00814,"completed_at":"2026-10-18T00:00:21.668Z","load_balancing_strategy":"primary","db_duration_s":0.000276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 238.297761] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"358cb47eea179c8ed4942e5c","created_at":"2026-10-18T00:00:21.296Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.296Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-358cb47eea179c8ed4942e5c: start","job_status":"start","queue_duration_s":0.372267,"scheduling_latency_s":0.372279}1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a'1966gitlab # [ 238.312227] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"358cb47eea179c8ed4942e5c","created_at":"2026-10-18T00:00:21.296Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.296Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-358cb47eea179c8ed4942e5c: done: 0.012742 sec","job_status":"done","queue_duration_s":0.372267,"scheduling_latency_s":0.372279,"redis_calls":7,"redis_duration_s":0.000843,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012742,"completed_at":"2026-10-18T00:00:21.681Z","load_balancing_strategy":"primary","db_duration_s":0.001804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a', in 0.04 seconds)1968gitlab # [ 238.368135] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.682Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ef72c364141f0d4f01d0a29f","created_at":"2026-10-18T00:00:21.400Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-b7d2160d74a04473","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.403Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ef72c364141f0d4f01d0a29f: start","job_status":"start","queue_duration_s":0.279603,"scheduling_latency_s":0.279615}1969(finished: subtest: push delivers the webhook, in 47.08 seconds)1970subtest: eval and build post commit statuses1971gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses1972gitlab # [ 238.368747] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.698Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ef72c364141f0d4f01d0a29f","created_at":"2026-10-18T00:00:21.400Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-b7d2160d74a04473","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.403Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ef72c364141f0d4f01d0a29f: done: 0.01591 sec","job_status":"done","queue_duration_s":0.279603,"scheduling_latency_s":0.279615,"redis_calls":7,"redis_duration_s":0.000899,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01591,"completed_at":"2026-10-18T00:00:21.698Z","load_balancing_strategy":"primary","db_duration_s":0.002635,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1973gitlab # [ 238.434593] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.699Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"11291fd15ba6ee3aa9411616","created_at":"2026-10-18T00:00:21.404Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-b7d2160d74a04473","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.405Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-11291fd15ba6ee3aa9411616: start","job_status":"start","queue_duration_s":0.293482,"scheduling_latency_s":0.293495}1974gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.07 seconds)1975gitlab # [ 238.435243] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.731Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"11291fd15ba6ee3aa9411616","created_at":"2026-10-18T00:00:21.404Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-b7d2160d74a04473","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.405Z","job_size_bytes":65,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-11291fd15ba6ee3aa9411616: done: 0.032185 sec","job_status":"done","queue_duration_s":0.293482,"scheduling_latency_s":0.293495,"redis_calls":10,"redis_duration_s":0.001704,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00067,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032185,"completed_at":"2026-10-18T00:00:21.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1976gitlab # [ 238.455262] nixbot[2603]: {"ts": "2026-10-18T00:00:22.152Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:58498 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1\" 200"}1977gitlab # [ 238.457669] gitaly[906]: time="2026-10-18T00:00:22.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YDMRKCVHR9EEWHK023T1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:52.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:22.198" grpc.time_ms=0.514 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 238.500735] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6dea1c19473492440269f2ef","created_at":"2026-10-18T00:00:21.443Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.444Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6dea1c19473492440269f2ef: start","job_status":"start","queue_duration_s":0.287999,"scheduling_latency_s":0.288019}1979gitlab # [ 238.501555] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:21.750Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6dea1c19473492440269f2ef","created_at":"2026-10-18T00:00:21.443Z","trace_propagation_headers":{"sentry-trace":"4f7d280c1cbb449099b58e35de9e4caf-b36f1d0c20824f99","baggage":"sentry-trace_id=4f7d280c1cbb449099b58e35de9e4caf,sentry-release=Unknown"},"correlation_id":"01M564YBP6G7SJBNK1B0B9P3GN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:21.444Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6dea1c19473492440269f2ef: done: 0.017506 sec","job_status":"done","queue_duration_s":0.287999,"scheduling_latency_s":0.288019,"redis_calls":8,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017506,"completed_at":"2026-10-18T00:00:21.750Z","load_balancing_strategy":"primary","db_duration_s":0.00299,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1980gitlab # [ 238.545987] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 501981gitlab # [ 238.565394] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:22.316Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0c6169aaffbeb6ced6c5689b","created_at":"2026-10-18T00:00:21.442Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-b7d2160d74a04473","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:22.315Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0c6169aaffbeb6ced6c5689b: start","job_status":"start","queue_duration_s":0.001251,"scheduling_latency_s":0.001282}1982gitlab # [ 238.591215] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:22 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 11831983gitlab # [ 238.599117] nixbot[2603]: {"ts": "2026-10-18T00:00:22.350Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-b43331a19211-6"}1984gitlab # [ 238.656743] gitaly[906]: time="2026-10-18T00:00:22.407Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:52.506" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:22.407" grpc.time_ms=0.613 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 238.690422] nixbot[2603]: {"ts": "2026-10-18T00:00:22.442Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-b43331a19211-6", "argv0": "bwrap"}1986gitlab # [ 238.698492] gitaly[906]: time="2026-10-18T00:00:22.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YCN6ESSYJHXR1498Z8GA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:52.548" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:22.449" grpc.time_ms=0.733 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 238.712607] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:22.463Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0c6169aaffbeb6ced6c5689b","created_at":"2026-10-18T00:00:21.442Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-b7d2160d74a04473","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:22.315Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0c6169aaffbeb6ced6c5689b: done: 0.147018 sec","job_status":"done","queue_duration_s":0.001251,"scheduling_latency_s":0.001282,"gitaly_calls":2,"gitaly_duration_s":0.006461,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009405,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001329,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001412,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.002592,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000301,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000324,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000789,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107062,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.107961766,"duration_s":0.147018,"completed_at":"2026-10-18T00:00:22.463Z","load_balancing_strategy":"primary","db_duration_s":0.029583,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1988gitlab # [ 238.759915] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:22.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"6878ca4ea36814eb1a689705","created_at":"2026-10-18T00:00:22.387Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-042bf615e3034e33","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:22.390Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6878ca4ea36814eb1a689705: start","job_status":"start","queue_duration_s":0.1207,"scheduling_latency_s":0.120726}1989gitlab # [ 238.782577] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:22.534Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"6878ca4ea36814eb1a689705","created_at":"2026-10-18T00:00:22.387Z","trace_propagation_headers":{"sentry-trace":"619b8792c25d44d7bc3f1c7c757f61eb-042bf615e3034e33","baggage":"sentry-trace_id=619b8792c25d44d7bc3f1c7c757f61eb,sentry-release=Unknown"},"correlation_id":"01M564YCN6ESSYJHXR1498Z8GA","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:22.390Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6878ca4ea36814eb1a689705: done: 0.023074 sec","job_status":"done","queue_duration_s":0.1207,"scheduling_latency_s":0.120726,"redis_calls":7,"redis_duration_s":0.001205,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023074,"completed_at":"2026-10-18T00:00:22.534Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1990gitlab # [ 238.797874] nix-daemon[2756]: accepted connection from pid 3597, user nixbot1991gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses1992gitlab # [ 239.560578] gitaly[906]: time="2026-10-18T00:00:23.312Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YEPWQ3481KGC5M2Z822W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:53.110" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:23.311" grpc.time_ms=0.762 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 239.589450] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 791994gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.13 seconds)1995gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses1996gitlab # [ 240.672498] gitaly[906]: time="2026-10-18T00:00:24.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YFSKQGBYDPBH2DMD9ZMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:54.221" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:24.422" grpc.time_ms=0.853 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 240.698798] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 771998gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.11 seconds)1999gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses2000gitlab # [ 241.835862] gitaly[906]: time="2026-10-18T00:00:25.586Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YGWKAYQ8EYV05PFQS7NH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:55.385" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:25.585" grpc.time_ms=0.863 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 241.865579] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1252002gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.16 seconds)2003gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses2004gitlab # [ 242.957410] gitaly[906]: time="2026-10-18T00:00:26.708Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YJ0ZFM5ZHQQJEN4RMJPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:56.506" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:26.707" grpc.time_ms=0.775 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 243.000318] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952006gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.14 seconds)2007gitlab # [ 243.712890] nix-daemon[2756]: accepted connection from pid 3633, user nixbot2008gitlab # [ 243.724498] nix-daemon[2756]: accepted connection from pid 3597, user nixbot2009gitlab # [ 243.818647] gitaly[906]: time="2026-10-18T00:00:27.570Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:57.269" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:27.569" grpc.time_ms=0.662 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 243.866200] gitaly[906]: time="2026-10-18T00:00:27.617Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:37.276" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.606" grpc.time_ms=10.88 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 243.940330] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:27.690Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"152037a4f8d1c3d4a8ae3f78","created_at":"2026-10-18T00:00:27.683Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-2bbfc774e7e04114","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.688Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-152037a4f8d1c3d4a8ae3f78: start","job_status":"start","queue_duration_s":0.001942,"scheduling_latency_s":0.001987}2012gitlab # [ 243.989205] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2242013gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses2014gitlab # [ 244.061324] gitaly[906]: time="2026-10-18T00:00:27.812Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YK34KHH14FQ3ZTK7RGA0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:57.511" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:27.811" grpc.time_ms=0.829 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 244.102800] gitaly[906]: time="2026-10-18T00:00:27.854Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YK4ADM5SD359ES28HA1K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:57.653" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:27.854" grpc.time_ms=0.336 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 244.110594] gitaly[906]: time="2026-10-18T00:00:27.862Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M564YK34KHH14FQ3ZTK7RGA0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:37.186" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.857" grpc.time_ms=4.953 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # [ 244.133262] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 842018gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.13 seconds)2019gitlab # [ 244.142106] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1442020gitlab # [ 244.149434] gitaly[906]: time="2026-10-18T00:00:27.900Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:27.899" grpc.time_ms=0.749 pid=906 span.kind=server system=grpc2021gitlab # [ 244.174620] gitaly[906]: time="2026-10-18T00:00:27.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:27.924" grpc.time_ms=0.934 pid=906 span.kind=server system=grpc2022gitlab # [ 244.184764] gitaly[906]: time="2026-10-18T00:00:27.936Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YK7YFAEVP3VFDF102GYB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:57.635" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:27.936" grpc.time_ms=0.319 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 244.199421] gitaly[906]: time="2026-10-18T00:00:27.951Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:27.950" grpc.time_ms=0.256 pid=906 span.kind=server system=grpc2024gitlab # [ 244.208723] gitaly[906]: time="2026-10-18T00:00:27.960Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:57.947" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.847" operations="[repack_refs]" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 244.218263] gitaly[906]: time="2026-10-18T00:00:27.961Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:57.947" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.847" pid=906 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-17 23:59:25.680257526 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2026gitlab # [ 244.218826] gitaly[906]: time="2026-10-18T00:00:27.967Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 diskcache=704eaa55-06f6-4bcc-8085-bb536e1b5aed grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:57.947" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.847" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 244.219475] gitaly[906]: time="2026-10-18T00:00:27.967Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7477 command.oublock=0 command.real_time_ms=113 command.spawn_token_fork_ms=4 command.system_time_ms=61 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:57.947" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.847" grpc.time_ms=119.787 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 244.251455] gitaly[906]: time="2026-10-18T00:00:28.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YK7YFAEVP3VFDF102GYB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-18T00:00:37.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.967" grpc.time_ms=35.288 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 244.253506] gitaly[906]: time="2026-10-18T00:00:28.005Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:57.947" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.847" pid=906 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2030gitlab # [ 244.254121] gitaly[906]: time="2026-10-18T00:00:28.005Z" level=info msg="optimized repository" clean_stale_data_time=43.026697ms clean_work_trees_time="68.165µs" commit_graph_time="3.632µs" correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=906 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.912µs" storage_name=default system=housekeeping total_time=43.197669ms2031gitlab # [ 244.254802] gitaly[906]: time="2026-10-18T00:00:28.005Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:57.947" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:27.847" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 244.281906] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b43331a192111173eaecebf518089ef9ff5cf59a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1302033gitlab # [ 244.294299] gitaly[906]: time="2026-10-18T00:00:28.046Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:58.145" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:28.045" grpc.time_ms=0.594 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 244.320998] gitaly[906]: time="2026-10-18T00:00:28.071Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:58.171" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:28.071" grpc.time_ms=0.444 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 244.326600] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.078Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b809d3837d066f8e6a96d5b1","created_at":"2026-10-18T00:00:28.076Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"152037a4f8d1c3d4a8ae3f78","job_size_bytes":3,"pid":2478,"job_status":"deduplicated","message":"PipelineProcessWorker JID-b809d3837d066f8e6a96d5b1: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2036gitlab # [ 244.327586] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.079Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"152037a4f8d1c3d4a8ae3f78","created_at":"2026-10-18T00:00:27.683Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-2bbfc774e7e04114","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.688Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2478,"job_status":"rescheduled","message":"PipelineProcessWorker JID-152037a4f8d1c3d4a8ae3f78: rescheduled"}2037gitlab # [ 244.331908] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.083Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"152037a4f8d1c3d4a8ae3f78","created_at":"2026-10-18T00:00:27.683Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-2bbfc774e7e04114","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.688Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-152037a4f8d1c3d4a8ae3f78: done: 0.393038 sec","job_status":"done","queue_duration_s":0.001942,"scheduling_latency_s":0.001987,"gitaly_calls":3,"gitaly_duration_s":0.126023,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011901,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001357,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000841,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002063,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003547,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000195,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000381,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00216,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.16051,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.31146249,"duration_s":0.393038,"completed_at":"2026-10-18T00:00:28.083Z","load_balancing_strategy":"primary","db_duration_s":0.060862,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2038gitlab # [ 244.365819] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7d0d41b857abab4d41bacf48","created_at":"2026-10-18T00:00:27.841Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.843Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7d0d41b857abab4d41bacf48: start","job_status":"start","queue_duration_s":0.240991,"scheduling_latency_s":0.241007}2039gitlab # [ 244.380558] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.112Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7d0d41b857abab4d41bacf48","created_at":"2026-10-18T00:00:27.841Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.843Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7d0d41b857abab4d41bacf48: done: 0.027824 sec","job_status":"done","queue_duration_s":0.240991,"scheduling_latency_s":0.241007,"redis_calls":7,"redis_duration_s":0.00103,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027824,"completed_at":"2026-10-18T00:00:28.112Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008046,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2040gitlab # [ 244.441750] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"58de811fc7bb813e1b32b1d2","created_at":"2026-10-18T00:00:27.973Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.975Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-58de811fc7bb813e1b32b1d2: start","job_status":"start","queue_duration_s":0.137891,"scheduling_latency_s":0.137906}2041gitlab # [ 244.442584] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.135Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"58de811fc7bb813e1b32b1d2","created_at":"2026-10-18T00:00:27.973Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.975Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-58de811fc7bb813e1b32b1d2: done: 0.022329 sec","job_status":"done","queue_duration_s":0.137891,"scheduling_latency_s":0.137906,"redis_calls":7,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022329,"completed_at":"2026-10-18T00:00:28.135Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2042gitlab # [ 244.483161] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c8d3a2bfd6cc99caa27d33aa","created_at":"2026-10-18T00:00:27.980Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.981Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c8d3a2bfd6cc99caa27d33aa: start","job_status":"start","queue_duration_s":0.15525,"scheduling_latency_s":0.155267}2043gitlab # [ 244.522322] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c8d3a2bfd6cc99caa27d33aa","created_at":"2026-10-18T00:00:27.980Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.981Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c8d3a2bfd6cc99caa27d33aa: done: 0.019604 sec","job_status":"done","queue_duration_s":0.15525,"scheduling_latency_s":0.155267,"redis_calls":7,"redis_duration_s":0.001678,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019604,"completed_at":"2026-10-18T00:00:28.156Z","load_balancing_strategy":"primary","db_duration_s":0.005012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 244.523266] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.157Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"9ff4d28a38645abce65f3e6f","created_at":"2026-10-18T00:00:27.987Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.988Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9ff4d28a38645abce65f3e6f: start","job_status":"start","queue_duration_s":0.169395,"scheduling_latency_s":0.169407}2045gitlab # [ 244.563622] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"9ff4d28a38645abce65f3e6f","created_at":"2026-10-18T00:00:27.987Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.988Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9ff4d28a38645abce65f3e6f: done: 0.01888 sec","job_status":"done","queue_duration_s":0.169395,"scheduling_latency_s":0.169407,"redis_calls":10,"redis_duration_s":0.001191,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000327,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01888,"completed_at":"2026-10-18T00:00:28.176Z","load_balancing_strategy":"primary","db_duration_s":0.002604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2046gitlab # [ 244.604154] nixbot[2603]: {"ts": "2026-10-18T00:00:28.271Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "b43331a192111173eaecebf518089ef9ff5cf59a", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2047gitlab # [ 244.604825] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 362048gitlab # [ 244.605483] gitaly[906]: time="2026-10-18T00:00:28.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YKM7SEWV9HSWPHD7JJ7K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:28.325" grpc.time_ms=5.483 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc2049gitlab # [ 244.606190] gitaly[906]: time="2026-10-18T00:00:28.351Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:28.351" grpc.time_ms=0.247 pid=906 span.kind=server system=grpc2050gitlab # [ 244.606906] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.177Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2526773db0509bd2263db28e","created_at":"2026-10-18T00:00:27.988Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.989Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2526773db0509bd2263db28e: start","job_status":"start","queue_duration_s":0.187896,"scheduling_latency_s":0.187909}2051gitlab # [ 244.646314] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.198Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2526773db0509bd2263db28e","created_at":"2026-10-18T00:00:27.988Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.989Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2526773db0509bd2263db28e: done: 0.020844 sec","job_status":"done","queue_duration_s":0.187896,"scheduling_latency_s":0.187909,"redis_calls":7,"redis_duration_s":0.001044,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020844,"completed_at":"2026-10-18T00:00:28.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2052gitlab # [ 244.654271] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.199Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4e6b8bd4c260622cd164971e","created_at":"2026-10-18T00:00:27.989Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.991Z","job_size_bytes":19,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4e6b8bd4c260622cd164971e: start","job_status":"start","queue_duration_s":0.208159,"scheduling_latency_s":0.208177}2053gitlab # [ 244.694202] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4e6b8bd4c260622cd164971e","created_at":"2026-10-18T00:00:27.989Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.991Z","job_size_bytes":19,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4e6b8bd4c260622cd164971e: done: 0.014387 sec","job_status":"done","queue_duration_s":0.208159,"scheduling_latency_s":0.208177,"redis_calls":8,"redis_duration_s":0.000943,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000215,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014387,"completed_at":"2026-10-18T00:00:28.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 244.707104] gitlab-workhorse[826]: time="2026-10-18T00:00:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672055gitlab # [ 244.708702] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 422056gitlab # [ 244.710263] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 492057gitlab # [ 244.712481] gitaly[906]: time="2026-10-18T00:00:28.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:28.371" grpc.time_ms=0.223 pid=906 span.kind=server system=grpc2058gitlab # [ 244.722571] gitaly[906]: time="2026-10-18T00:00:28.375Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M564YKNCCYZ7CR7PS3MAY5Q9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:28.369" pid=906 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2059gitlab # [ 244.767891] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.214Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4ed2d66bd43165b848571108","created_at":"2026-10-18T00:00:27.991Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.992Z","job_size_bytes":66,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4ed2d66bd43165b848571108: start","job_status":"start","queue_duration_s":0.221818,"scheduling_latency_s":0.221832}2060gitlab # [ 244.768681] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.226Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4ed2d66bd43165b848571108","created_at":"2026-10-18T00:00:27.991Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.992Z","job_size_bytes":66,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4ed2d66bd43165b848571108: done: 0.012431 sec","job_status":"done","queue_duration_s":0.221818,"scheduling_latency_s":0.221832,"redis_calls":7,"redis_duration_s":0.0008060000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000216,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012431,"completed_at":"2026-10-18T00:00:28.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 244.784797] gitaly[906]: time="2026-10-18T00:00:28.375Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564YKNCCYZ7CR7PS3MAY5Q9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:28.369" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc2062gitlab # [ 244.832175] gitlab-workhorse[826]: time="2026-10-18T00:00:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672063gitlab # [ 244.832855] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/18:00:00:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 512064gitlab # [ 244.833514] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"97d80038060bbd72244b68e8","created_at":"2026-10-18T00:00:27.993Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.993Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-97d80038060bbd72244b68e8: start","job_status":"start","queue_duration_s":0.234305,"scheduling_latency_s":0.234319}2065gitlab # [ 244.834204] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.247Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"97d80038060bbd72244b68e8","created_at":"2026-10-18T00:00:27.993Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.993Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-97d80038060bbd72244b68e8: done: 0.019726 sec","job_status":"done","queue_duration_s":0.234305,"scheduling_latency_s":0.234319,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019726,"completed_at":"2026-10-18T00:00:28.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2066gitlab # [ 244.851738] gitaly[906]: time="2026-10-18T00:00:28.375Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M564YKNCCYZ7CR7PS3MAY5Q9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:28.369" grpc.time_ms=5.839 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc2067gitlab # [ 244.890695] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.248Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"6f425847e460e71d925f3473","created_at":"2026-10-18T00:00:27.996Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.997Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6f425847e460e71d925f3473: start","job_status":"start","queue_duration_s":0.251636,"scheduling_latency_s":0.251649}2068gitlab # [ 244.891594] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.263Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"6f425847e460e71d925f3473","created_at":"2026-10-18T00:00:27.996Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.997Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6f425847e460e71d925f3473: done: 0.014733 sec","job_status":"done","queue_duration_s":0.251636,"scheduling_latency_s":0.251649,"redis_calls":7,"redis_duration_s":0.000975,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000221,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014733,"completed_at":"2026-10-18T00:00:28.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069gitlab # [ 244.917532] gitaly[906]: time="2026-10-18T00:00:28.396Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-18T00:00:28.396" grpc.time_ms=0.226 pid=906 span.kind=server system=grpc2070gitlab # [ 244.925775] gitaly[906]: time="2026-10-18T00:00:28.404Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 diskcache=3f1cc554-bb80-4f2a-b315-14986c8af4a5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:58.432" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:28.334" pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 244.934672] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0c6344bd1ebaad843cd042f9","created_at":"2026-10-18T00:00:27.997Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.998Z","job_size_bytes":6,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0c6344bd1ebaad843cd042f9: start","job_status":"start","queue_duration_s":0.266123,"scheduling_latency_s":0.266136}2072gitlab # [ 244.977936] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.272Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0c6344bd1ebaad843cd042f9","created_at":"2026-10-18T00:00:27.997Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.998Z","job_size_bytes":6,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0c6344bd1ebaad843cd042f9: done: 0.008308 sec","job_status":"done","queue_duration_s":0.266123,"scheduling_latency_s":0.266136,"redis_calls":7,"redis_duration_s":0.001017,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008308,"completed_at":"2026-10-18T00:00:28.272Z","load_balancing_strategy":"primary","db_duration_s":0.000216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 244.985854] gitaly[906]: time="2026-10-18T00:00:28.404Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7602 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-18T00:00:58.432" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-18T00:00:28.334" grpc.time_ms=70.562 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 244.997666] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.273Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"21fc60fd3b340c0a6c0544d7","created_at":"2026-10-18T00:00:27.998Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.999Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-21fc60fd3b340c0a6c0544d7: start","job_status":"start","queue_duration_s":0.274235,"scheduling_latency_s":0.274247}2075gitlab # [ 245.043559] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"21fc60fd3b340c0a6c0544d7","created_at":"2026-10-18T00:00:27.998Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:27.999Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-21fc60fd3b340c0a6c0544d7: done: 0.016616 sec","job_status":"done","queue_duration_s":0.274235,"scheduling_latency_s":0.274247,"redis_calls":7,"redis_duration_s":0.0009339999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016616,"completed_at":"2026-10-18T00:00:28.290Z","load_balancing_strategy":"primary","db_duration_s":0.002688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2076gitlab # [ 245.048119] gitaly[906]: time="2026-10-18T00:00:28.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M564YKQHXR2081FR3WBXQWEW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-18T00:00:28.441" grpc.time_ms=8.588 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc2077gitlab # [ 245.086156] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.290Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"8bc9fc76ab22fe1193f17c50","created_at":"2026-10-18T00:00:28.079Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:28.080Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8bc9fc76ab22fe1193f17c50: start","job_status":"start","queue_duration_s":0.210482,"scheduling_latency_s":0.210497}2078gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses2079gitlab # [ 245.086869] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.487Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"8bc9fc76ab22fe1193f17c50","created_at":"2026-10-18T00:00:28.079Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-1b6e49dbb83746b6","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:28.080Z","job_size_bytes":3,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8bc9fc76ab22fe1193f17c50: done: 0.196166 sec","job_status":"done","queue_duration_s":0.210482,"scheduling_latency_s":0.210497,"gitaly_calls":3,"gitaly_duration_s":0.08136,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013375999999999999,"redis_read_bytes":144,"redis_write_bytes":16874,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000458,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001832,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.003812,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11223,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.003938,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00012,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000343,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074399,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.173290739,"duration_s":0.196166,"completed_at":"2026-10-18T00:00:28.487Z","load_balancing_strategy":"primary","db_duration_s":0.02738,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2080gitlab # [ 245.133321] gitaly[906]: time="2026-10-18T00:00:28.452Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-18T00:00:58.549" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:28.450" grpc.time_ms=1.735 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 245.133927] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"66959139515d6ad81c34cab0","created_at":"2026-10-18T00:00:28.327Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-6b3bd62a5c2e426d","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:28.329Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-66959139515d6ad81c34cab0: start","job_status":"start","queue_duration_s":0.158868,"scheduling_latency_s":0.158885}2082gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b43331a192111173eaecebf518089ef9ff5cf59a/statuses, in 0.07 seconds)2083(finished: subtest: eval and build post commit statuses, in 6.81 seconds)2084(finished: run the VM test script, in 300.55 seconds)2085gitlab # [ 245.143762] sidekiq-cluster[2478]: {"severity":"INFO","time":"2026-10-18T00:00:28.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"66959139515d6ad81c34cab0","created_at":"2026-10-18T00:00:28.327Z","trace_propagation_headers":{"sentry-trace":"d9d072c5b2494fe785015bd603e91854-6b3bd62a5c2e426d","baggage":"sentry-trace_id=d9d072c5b2494fe785015bd603e91854,sentry-release=Unknown"},"correlation_id":"01M564YJVVPEBZH2J5MTWGMGZ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-18T00:00:28.329Z","job_size_bytes":23,"pid":2478,"sidekiq_tid":"m7qe","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-66959139515d6ad81c34cab0: done: 0.02676 sec","job_status":"done","queue_duration_s":0.158868,"scheduling_latency_s":0.158885,"redis_calls":7,"redis_duration_s":0.001286,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02676,"completed_at":"2026-10-18T00:00:28.514Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006271,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2086test script finished in 300.57s2087cleanup2088kill QemuMachine (pid 46)2089gitlab # [ 245.184118] gitaly[906]: time="2026-10-18T00:00:28.475Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M564YJVVPEBZH2J5MTWGMGZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-18T00:00:58.573" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-18T00:00:28.473" grpc.time_ms=2.308 pid=906 remote_ip="2001:db8:1::1" span.kind=server system=grpc qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2090gitlab # u2091(finished: cleanup, in 1.27 seconds)2092additionally exposed symbols:2093 gitlab,2094 vlan1,2095 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2096[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-17T23:59:34.645Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2097[]2098[]2099[]2100[]2101[]2102[]2103[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-18T00:00:21.153961Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2104[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2105[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2106[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2107[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2108[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2109[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': '2026-10-18T00:00:27.673Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2110[{'id': 5, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-18T00:00:21.437Z', 'started_at': None, 'finished_at': '2026-10-18T00:00:27.673Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'b43331a192111173eaecebf518089ef9ff5cf59a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-18T00:00:27.878Z', 'started_at': None, 'finished_at': '2026-10-18T00:00:28.018Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]