vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #395
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.zgtmYMzwZW', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 62.83 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: c48dca42-7b3c-46f9-8ddc-94b8c0079a1f19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zb3961kfaha71igl99liykhf056x5wjs-nixos-system-gitlab-test/init regInfo=/nix/store/0s7k1h5kx2krf0wafd6bndbz4slq74pl-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 449165567 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000813] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000881] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002738] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002749] Using GB pages for direct mapping73gitlab # [ 0.002924] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002931] ACPI: Early table checksum verification disabled75gitlab # [ 0.002933] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002937] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002941] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002948] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002950] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002951] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002953] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002954] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002956] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002957] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002957] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002958] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002958] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002959] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003179] No NUMA configuration found90gitlab # [ 0.003179] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003182] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005294] Zone ranges:93gitlab # [ 0.005294] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005296] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005297] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005298] Device empty97gitlab # [ 0.005298] Movable zone start for each node98gitlab # [ 0.005299] Early memory node ranges99gitlab # [ 0.005300] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005301] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005302] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005303] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005322] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005576] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.107558] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.107986] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.108001] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.108031] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.108034] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.108035] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.108037] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.108038] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.108038] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.108041] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.108042] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.108046] TSC deadline timer available117gitlab # [ 0.108051] CPU topo: Max. logical packages: 1118gitlab # [ 0.108052] CPU topo: Max. logical dies: 1119gitlab # [ 0.108052] CPU topo: Max. dies per package: 1120gitlab # [ 0.108056] CPU topo: Max. threads per core: 1121gitlab # [ 0.108057] CPU topo: Num. cores per package: 4122gitlab # [ 0.108057] CPU topo: Num. threads per package: 4123gitlab # [ 0.108058] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.108081] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.108097] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.108100] kvm-guest: setup PV sched yield127gitlab # [ 0.108116] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.108118] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.108119] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.108120] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.108122] Booting paravirtualized kernel on KVM132gitlab # [ 0.108125] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.112549] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.114622] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.114673] kvm-guest: PV spinlocks enabled136gitlab # [ 0.114675] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.114678] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zb3961kfaha71igl99liykhf056x5wjs-nixos-system-gitlab-test/init regInfo=/nix/store/0s7k1h5kx2krf0wafd6bndbz4slq74pl-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.114771] Unknown kernel command line parameters "regInfo=/nix/store/0s7k1h5kx2krf0wafd6bndbz4slq74pl-closure-info/registration", will be passed to user space.139gitlab # [ 0.114784] random: crng init done140gitlab # [ 0.114785] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.123031] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.127231] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.127302] software IO TLB: area num 4.144gitlab # [ 0.197752] Fallback order for Node 0: 0145gitlab # [ 0.197760] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.197761] Policy zone: Normal147gitlab # [ 0.200141] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.209422] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.222108] allocated 12582912 bytes of page_ext150gitlab # [ 0.231688] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.231690] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.232522] Dynamic Preempt: lazy153gitlab # [ 0.232667] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.232675] rcu: RCU event tracing is enabled.155gitlab # [ 0.232676] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.232677] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.232678] Rude variant of Tasks RCU enabled.158gitlab # [ 0.232678] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.232679] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.232680] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.232699] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.232701] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.232702] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.237026] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.237341] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.237349] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.237458] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.241058] Console: colour VGA+ 80x25169gitlab # [ 0.241061] printk: legacy console [tty0] enabled170gitlab # [ 0.271982] printk: legacy console [ttyS0] enabled171gitlab # [ 0.380140] ACPI: Core revision 20250807172gitlab # [ 0.381089] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.382689] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.383760] x2apic enabled175gitlab # [ 0.384504] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.385447] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.386730] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.388247] kvm-guest: setup PV IPIs179gitlab # [ 0.389871] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.390928] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.392758] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.393842] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.394874] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.396756] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.397759] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.398756] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.399756] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.401538] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.402510] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.403547] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.404763] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.405756] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.406756] active return thunk: srso_alias_return_thunk194gitlab # [ 0.407777] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.408755] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.410755] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.411755] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.412754] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.413755] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.414756] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.415756] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.417566] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.418547] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.419546] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.420567] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.421755] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.451212] Freeing SMP alternatives memory: 44K208gitlab # [ 0.451758] pid_max: default: 32768 minimum: 301209gitlab # [ 0.452852] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.453855] landlock: Up and running.211gitlab # [ 0.454756] Yama: becoming mindful.212gitlab # [ 0.455601] LSM support for eBPF active213gitlab # [ 0.456467] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.457890] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.460519] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.461329] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.461761] ... version: 2218gitlab # [ 0.462496] ... bit width: 48219gitlab # [ 0.462758] ... generic counters: 6220gitlab # [ 0.463531] ... generic bitmap: 000000000000003f221gitlab # [ 0.463806] ... fixed-purpose counters: 0222gitlab # [ 0.464591] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.465503] ... value mask: 0000ffffffffffff224gitlab # [ 0.465758] ... max period: 00007fffffffffff225gitlab # [ 0.466710] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.467633] signal: max sigframe size: 3376227gitlab # [ 0.468386] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.468761] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.469844] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.475193] smp: Bringing up secondary CPUs ...231gitlab # [ 0.476137] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.476766] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.479898] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.481758] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.483106] Memory: 6011568K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.484758] devtmpfs: initialized237gitlab # [ 0.485597] x86/mm: Memory block size: 128MB238gitlab # [ 0.488825] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.489891] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.490845] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.492070] PM: RTC time: 14:09:55, date: 2026-10-02242gitlab # [ 0.495483] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.497058] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.497803] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.499784] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.500769] audit: initializing netlink subsys (disabled)247gitlab # [ 0.501874] audit: type=2000 audit(1790950195.999:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.501974] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.503759] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.504758] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.505758] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.506758] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.507792] cpuidle: using governor menu254gitlab # [ 0.509970] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.510995] PCI: Using configuration type 1 for base access256gitlab # [ 0.511759] PCI: Using configuration type 1 for extended access257gitlab # [ 0.512907] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.516128] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.516759] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.517758] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.518758] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.524292] ACPI: Added _OSI(Module Device)263gitlab # [ 0.525765] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.527767] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.534833] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.542260] ACPI: Interpreter enabled267gitlab # [ 0.543834] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.545776] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.547911] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.551765] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.554097] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.566803] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.568771] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.572499] acpiphp: Slot [3] registered275gitlab # [ 0.573782] acpiphp: Slot [4] registered276gitlab # [ 0.575801] acpiphp: Slot [5] registered277gitlab # [ 0.576817] acpiphp: Slot [6] registered278gitlab # [ 0.577803] acpiphp: Slot [7] registered279gitlab # [ 0.579800] acpiphp: Slot [8] registered280gitlab # [ 0.580815] acpiphp: Slot [9] registered281gitlab # [ 0.582803] acpiphp: Slot [10] registered282gitlab # [ 0.583800] acpiphp: Slot [11] registered283gitlab # [ 0.584801] acpiphp: Slot [12] registered284gitlab # [ 0.586817] acpiphp: Slot [13] registered285gitlab # [ 0.587802] acpiphp: Slot [14] registered286gitlab # [ 0.588783] acpiphp: Slot [15] registered287gitlab # [ 0.589530] acpiphp: Slot [16] registered288gitlab # [ 0.590795] acpiphp: Slot [17] registered289gitlab # [ 0.591554] acpiphp: Slot [18] registered290gitlab # [ 0.591778] acpiphp: Slot [19] registered291gitlab # [ 0.592501] acpiphp: Slot [20] registered292gitlab # [ 0.593786] acpiphp: Slot [21] registered293gitlab # [ 0.594547] acpiphp: Slot [22] registered294gitlab # [ 0.594779] acpiphp: Slot [23] registered295gitlab # [ 0.595515] acpiphp: Slot [24] registered296gitlab # [ 0.596779] acpiphp: Slot [25] registered297gitlab # [ 0.597547] acpiphp: Slot [26] registered298gitlab # [ 0.597778] acpiphp: Slot [27] registered299gitlab # [ 0.598511] acpiphp: Slot [28] registered300gitlab # [ 0.599778] acpiphp: Slot [29] registered301gitlab # [ 0.600536] acpiphp: Slot [30] registered302gitlab # [ 0.600778] acpiphp: Slot [31] registered303gitlab # [ 0.601503] PCI host bridge to bus 0000:00304gitlab # [ 0.602769] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.603759] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.604758] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.606759] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.607758] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.608759] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.610037] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.615496] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.619837] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.626851] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.628832] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.631764] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.633763] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.636764] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.639208] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.645917] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.650452] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.654452] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.657780] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.661219] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.676682] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.677666] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.678588] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.679959] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.683218] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.690803] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.692781] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.694818] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.725783] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.732266] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.739793] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.741775] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.743804] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.747039] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.751796] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.752721] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.753546] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.756417] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.759790] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.760712] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.761583] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.765052] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.768794] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.769729] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.770578] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.773009] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.777794] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.778765] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.779780] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.782125] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.785608] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.786479] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.788545] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.789764] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.791988] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.794797] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.795780] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.798244] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.800766] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.801658] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.803547] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.805972] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.808533] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.809766] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.810786] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.815439] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.816981] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.818902] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.819892] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.820844] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.824092] iommu: Default domain type: Translated375gitlab # [ 0.824760] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.826029] ACPI: bus type USB registered377gitlab # [ 0.826826] usbcore: registered new interface driver usbfs378gitlab # [ 0.827780] usbcore: registered new interface driver hub379gitlab # [ 0.828787] usbcore: registered new device driver usb380gitlab # [ 0.830811] NetLabel: Initializing381gitlab # [ 0.831418] NetLabel: domain hash size = 128382gitlab # [ 0.832758] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.833824] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.834768] PCI: Using ACPI for IRQ routing385gitlab # [ 0.836113] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.836754] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.836754] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.839762] vgaarb: loaded389gitlab # [ 0.840524] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.840758] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.844839] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.849277] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.850020] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.851793] pnp: PnP ACPI init395gitlab # [ 0.852950] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.862720] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.864324] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.865340] NET: Registered PF_INET protocol family399gitlab # [ 0.867466] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.885080] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.886658] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.888089] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.891792] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.893160] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.894383] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.895793] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.897435] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.898808] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.899867] NET: Registered PF_XDP protocol family410gitlab # [ 0.900767] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.901855] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.902945] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.904117] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.905291] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.906701] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.907732] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.910179] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.912837] PCI: CLS 0 bytes, default 64419gitlab # [ 0.913648] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.914125] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.914761] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.914878] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 0.938144] Initialise system trusted keyrings424gitlab # [ 0.939429] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.950957] Key type asymmetric registered426gitlab # [ 0.951748] Asymmetric key parser 'x509' registered427gitlab # [ 0.952686] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.954547] io scheduler mq-deadline registered429gitlab # [ 0.955340] io scheduler kyber registered430gitlab # [ 0.959162] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.960529] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.962999] Linux agpgart interface v0.103433gitlab # [ 0.963824] ACPI: bus type drm_connector registered434gitlab # [ 0.969164] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.970314] usbserial: USB Serial support registered for generic436gitlab # [ 0.971345] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.971345] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.973767] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.975223] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.976486] NET: Registered PF_INET6 protocol family441gitlab # [ 0.978248] Segment Routing with IPv6442gitlab # [ 0.978958] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.981882] IPI shorthand broadcast: enabled444gitlab # [ 0.986273] sched_clock: Marking stable (837010541, 148405963)->(1007696861, -22280357)445gitlab # [ 0.988157] registered taskstats version 1446gitlab # [ 0.989249] Loading compiled-in X.509 certificates447gitlab # [ 0.998854] Demotion targets for Node 0: null448gitlab # [ 0.999973] Key type .fscrypt registered449gitlab # [ 1.000738] Key type fscrypt-provisioning registered450gitlab # [ 1.001743] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.002718] ima: Allocated hash algorithm: sha1452gitlab # [ 1.003585] ima: No architecture policies found453gitlab # [ 1.004731] PM: Magic number: 14:275:181454gitlab # [ 1.006362] RAS: Correctable Errors collector initialized.455gitlab # [ 1.010828] clk: Disabling unused clocks456gitlab # [ 1.011588] PM: genpd: Disabling unused power domains457gitlab # [ 1.219257] Freeing initrd memory: 29392K458gitlab # [ 1.222910] Freeing unused decrypted memory: 2028K459gitlab # [ 1.225944] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.228046] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.232265] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.236142] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.304535] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.305681] Run /init as init process465gitlab # [ 1.318384] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.340948] fuse: init (API version 7.45)467gitlab # [ 1.349169] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.355763] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.358913] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.393030] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.729858] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.771120] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.773310] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.775556] systemd[1]: Running in initrd.475gitlab # [ 1.778021] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.781035] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.910706] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.954088] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.975050] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.976264] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.977742] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.978963] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.980146] systemd[1]: Reached target Path Units.484gitlab # [ 1.981103] systemd[1]: Reached target Slice Units.485gitlab # [ 1.982029] systemd[1]: Reached target Swaps.486gitlab # [ 1.982874] systemd[1]: Reached target Timer Units.487gitlab # [ 1.983917] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.985187] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.986380] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.987454] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.988485] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.989484] systemd[1]: Reached target Socket Units.493gitlab # [ 1.991609] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.993745] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.995764] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.998481] systemd[1]: Starting Journal Service...497gitlab # [ 2.005685] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.009684] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.015854] systemd-journald[90]: Collecting audit messages is disabled.500gitlab # [ 2.030625] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.039761] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.044123] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.060936] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.062221] netfs: FS-Cache loaded505gitlab # [ 1.915832] systemd-modules-load[93]: Using 4 probe threads506gitlab # [ 1.918252] systemd-modules-load[93]: Inserted module 'virtio_balloon'507gitlab # [ 2.069197] systemd[1]: Started Journal Service.508gitlab # [ 2.072833] 9pnet: Installing 9P2000 support509gitlab # [ 1.925055] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 1.927209] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...511gitlab # [ 1.929212] systemd-modules-load[93]: Inserted module 'virtio_gpu'512gitlab # [ 2.078621] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.513gitlab # [ 2.080733] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev514gitlab # [ 1.933958] systemd-modules-load[93]: Inserted module 'dm_mod'515gitlab # [ 1.936303] systemd[1]: Finished Load Kernel Modules.516gitlab # [ 1.937607] systemd[1]: Starting Apply Kernel Variables...517gitlab # [ 1.938605] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.518gitlab # [ 1.939680] systemd[1]: Finished Load Kernel Module 9pnet_virtio.519gitlab # [ 1.942371] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.520gitlab # [ 1.945409] systemd[1]: Starting Create Static Device Nodes in /dev...521gitlab # [ 1.952043] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.956274] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.957247] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.958213] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.959104] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.962182] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.972489] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.981816] systemd-udevd[114]: Using default interface naming scheme 'v261'.529gitlab # [ 1.992493] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.024571] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.025528] systemd[1]: Reached target System Initialization.532gitlab # [ 2.026344] systemd[1]: Reached target Basic System.533gitlab # [ 2.256772] SCSI subsystem initialized534gitlab # [ 2.260132] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.263472] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.264557] uhci_hcd 0000:00:01.2: detected 2 ports537gitlab # [ 2.265368] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.267137] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.268422] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.269472] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.270137] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd542gitlab # [ 2.271253] usb usb1: SerialNumber: 0000:00:01.2543gitlab # [ 2.272282] hub 1-0:1.0: USB hub found544gitlab # [ 2.272995] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.276047] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12546gitlab # [ 2.282509] virtio_blk virtio4: 4/0/0 default/read/poll queues547gitlab # [ 2.282549] serio: i8042 KBD port at 0x60,0x64 irq 1548gitlab # [ 2.284358] serio: i8042 AUX port at 0x60,0x64 irq 12549gitlab # [ 2.287305] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.328928] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.184837] systemd[1]: Starting Virtual Console Setup...552gitlab # [ 2.185884] (udev-worker)[129]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.553gitlab # [ 2.188059] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line.554gitlab # [ 2.336903] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0555gitlab # [ 2.337211] scsi host0: ata_piix556gitlab # [ 2.343164] virtio_blk virtio5: [vdb] 11952464 512-byte logical blocks (6.12 GB/5.70 GiB)557gitlab # [ 2.200955] (udev-worker)[127]: Network interface NamePolicy= disabled on kernel command line.558gitlab # [ 2.202485] systemd-vconsole-setup[148]: Configuration of first virtual console was skipped, ignoring remaining ones.559gitlab # [ 2.204710] systemd[1]: Finished Virtual Console Setup.560gitlab # [ 2.354434] scsi host1: ata_piix561gitlab # [ 2.356491] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0562gitlab # [ 2.358300] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0563gitlab # [ 2.214623] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.215601] systemd[1]: Reached target Initrd Root Device.565gitlab # [ 2.216573] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...566gitlab # [ 2.217813] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.243824] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.246536] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.490640] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.523124] ata2: found unknown device (class 0)571gitlab # [ 2.525948] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100572gitlab # [ 2.530237] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5573gitlab # [ 2.583769] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.612113] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.660295] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.663394] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.666198] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.667928] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.669470] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.700845] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.715364] usbcore: registered new interface driver usbhid582gitlab # [ 2.717517] usbhid: USB HID core driver583gitlab # [ 2.726864] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.730994] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.891580] systemd[1]: Mounting /sysroot...586gitlab # [ 3.170073] EXT4-fs (vda): mounted filesystem c48dca42-7b3c-46f9-8ddc-94b8c0079a1f r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.027406] systemd[1]: Mounted /sysroot.588gitlab # [ 3.029071] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.031450] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.033357] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.036332] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.037980] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.042223] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.043653] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.054079] systemd[1]: Mounted /sysroot/run.596gitlab # [ 3.208350] 9p: Installing v9fs 9p2000 file system support597gitlab # [ 3.065736] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 3.067416] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.599gitlab # [ 3.069958] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 3.071062] systemd[1]: Mounted /sysroot/tmp/xchg.601gitlab # [ 3.072147] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...602gitlab # [ 3.074689] systemd[1]: Reloading...603gitlab # [ 3.228338] erofs (device vdb): mounted with root inode @ nid 128.604gitlab # [ 3.131233] systemd[1]: Reloading finished in 59 ms.605gitlab # [ 3.160313] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...606gitlab # [ 3.163255] systemd[1]: Mounted /sysroot/nix/.ro-store.607gitlab # [ 3.165100] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...608gitlab # [ 3.167547] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.169201] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.170989] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.172771] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.192670] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.194663] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 3.892793] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 3.942665] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 3.944666] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 3.946723] systemd[1]: Starting Find NixOS closure...618gitlab # [ 3.948694] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 3.967470] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 3.970309] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.621gitlab # [ 3.985523] systemd[1]: Finished Find NixOS closure.622gitlab # [ 3.987442] systemd[1]: Reached target Initrd Default Target.623gitlab # [ 3.989401] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...624gitlab # [ 4.021959] systemd[1]: Stopped target Initrd Default Target.625gitlab # [ 4.024172] systemd[1]: Stopped target Basic System.626gitlab # [ 4.025901] systemd[1]: Stopped target Initrd Root Device.627gitlab # [ 4.027743] systemd[1]: Stopped target Path Units.628gitlab # [ 4.029418] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.629gitlab # [ 4.031896] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.630gitlab # [ 4.035508] systemd[1]: Stopped target Slice Units.631gitlab # [ 4.039180] systemd[1]: Stopped target Socket Units.632gitlab # [ 4.041724] systemd[1]: Stopped target System Initialization.633gitlab # [ 4.043770] systemd[1]: Stopped target Swaps.634gitlab # [ 4.045369] systemd[1]: Stopped target Timer Units.635gitlab # [ 4.047120] systemd[1]: dbus.socket: Deactivated successfully.636gitlab # [ 4.049164] systemd[1]: Closed D-Bus System Message Bus Socket.637gitlab # [ 4.051180] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.638gitlab # [ 4.053550] systemd[1]: Stopped Find NixOS closure.639gitlab # [ 4.055246] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio640gitlab # [ 4.058598] systemd[1]: Starting rw-sysroot-nix-store.service...641gitlab # [ 4.060345] systemd[1]: systemd-sysctl.service: Deactivated successfully.642gitlab # [ 4.062143] systemd[1]: Stopped Apply Kernel Variables.643gitlab # [ 4.063497] systemd[1]: systemd-modules-load.service: Deactivated successfully.644gitlab # [ 4.065363] systemd[1]: Stopped Load Kernel Modules.645gitlab # [ 4.066734] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.646gitlab # [ 4.068756] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.647gitlab # [ 4.070852] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.648gitlab # [ 4.072756] systemd[1]: Stopped Create System Files and Directories.649gitlab # [ 4.074397] systemd[1]: Stopped target Local File Systems.650gitlab # [ 4.075848] systemd[1]: Stopped target Preparation for Local File Systems.651gitlab # [ 4.077151] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.652gitlab # [ 4.078425] systemd[1]: Stopped Coldplug All udev Devices.653gitlab # [ 4.079491] systemd[1]: Stopping Rule-based Manager for Device Events and Files...654gitlab # [ 4.080784] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.655gitlab # [ 4.081884] systemd[1]: Stopped Virtual Console Setup.656gitlab # [ 4.082795] systemd[1]: initrd-cleanup.service: Deactivated successfully.657gitlab # [ 4.085201] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.658gitlab # [ 4.086234] systemd[1]: systemd-udevd.service: Deactivated successfully.659gitlab # [ 4.087322] systemd[1]: Stopped Rule-based Manager for Device Events and Files.660gitlab # [ 4.088374] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.661gitlab # [ 4.089523] systemd[1]: Closed udev Control Socket.662gitlab # [ 4.090295] systemd[1]: Starting Cleanup udev Database...663gitlab # [ 4.091089] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.664gitlab # [ 4.092361] systemd[1]: Stopped Create Static Device Nodes in /dev.665gitlab # [ 4.093225] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.666gitlab # [ 4.094340] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.667gitlab # [ 4.095349] systemd[1]: kmod-static-nodes.service: Deactivated successfully.668gitlab # [ 4.096347] systemd[1]: Stopped Create List of Static Device Nodes.669gitlab # [ 4.098461] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.670gitlab # [ 4.100185] systemd[1]: Finished rw-sysroot-nix-store.service.671gitlab # [ 4.101506] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.672gitlab # [ 4.102948] systemd[1]: Finished Cleanup udev Database.673gitlab # [ 4.104202] systemd[1]: Reached target Switch Root.674gitlab # [ 4.105347] systemd[1]: Starting NixOS Activation...675gitlab # [ 4.203113] initrd-nixos-activation-start[224]: booting system configuration /nix/store/zb3961kfaha71igl99liykhf056x5wjs-nixos-system-gitlab-test676gitlab # [ 4.237625] initrd-nixos-activation-start[224]: running activation script...677gitlab # [ 4.466153] initrd-nixos-activation-start[247]: setting up /etc...678gitlab # [ 4.590127] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.679gitlab # [ 4.593382] systemd[1]: Finished NixOS Activation.680gitlab # [ 4.598114] systemd[1]: Starting Switch Root...681gitlab # [ 4.615452] systemd[1]: Switching root.682gitlab # [ 4.822722] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).683gitlab # [ 4.926638] NET: Registered PF_VSOCK protocol family684gitlab # [ 5.293216] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)685gitlab # [ 5.303543] systemd[1]: Detected virtualization kvm.686gitlab # [ 5.305364] systemd[1]: Detected architecture x86-64.687gitlab # [ 5.307482] systemd[1]: Detected first boot.688gitlab # [ 5.310023] systemd[1]: Initializing machine ID from random generator.689gitlab # [ 5.456063] systemd[1]: bpf-restrict-fs: LSM BPF program attached690gitlab # [ 5.554114] systemd[1]: Applying preset policy.691gitlab # [ 5.679455] systemd[1]: Populated /etc with preset unit settings.692gitlab # [ 5.791916] systemd[1]: initrd-switch-root.service: Deactivated successfully.693gitlab # [ 5.793517] systemd[1]: Stopped initrd-switch-root.service.694gitlab # [ 5.795651] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.695gitlab # [ 5.797710] systemd[1]: Created slice Slice /system/getty.696gitlab # [ 5.799104] systemd[1]: Created slice GitLab DevOps Platform Slice.697gitlab # [ 5.800627] systemd[1]: Created slice User and Session Slice.698gitlab # [ 5.801598] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.699gitlab # [ 5.802871] systemd[1]: Started Forward Password Requests to Wall Directory Watch.700gitlab # [ 5.804049] systemd[1]: Expecting device /dev/hvc0...701gitlab # [ 5.804861] systemd[1]: Expecting device /dev/ttyS0...702gitlab # [ 5.805743] systemd[1]: Reached target Local Encrypted Volumes.703gitlab # [ 5.806624] systemd[1]: Stopped target initrd-fs.target.704gitlab # [ 5.807369] systemd[1]: Stopped target initrd-root-fs.target.705gitlab # [ 5.808220] systemd[1]: Stopped target initrd-switch-root.target.706gitlab # [ 5.809117] systemd[1]: Reached target Virtual Machines and Containers.707gitlab # [ 5.810192] systemd[1]: Reached target Path Units.708gitlab # [ 5.810966] systemd[1]: Reached target Remote File Systems.709gitlab # [ 5.811796] systemd[1]: Reached target Slice Units.710gitlab # [ 5.812560] systemd[1]: Reached target Swaps.711gitlab # [ 5.814021] systemd[1]: Listening on Query the User Interactively for a Password.712gitlab # [ 5.816060] systemd[1]: Listening on Process Core Dump Socket.713gitlab # [ 5.817559] systemd[1]: Listening on Credential Encryption/Decryption.714gitlab # [ 5.819182] systemd[1]: Listening on Factory Reset Management.715gitlab # [ 5.820171] systemd[1]: Listening on Hostname Service Socket.716gitlab # [ 5.822589] systemd[1]: Starting Journal Log Access Socket...717gitlab # [ 5.824045] systemd[1]: Listening on Journal Audit Socket.718gitlab # [ 5.826074] systemd[1]: Listening on Console Output Muting Service Socket.719gitlab # [ 5.827278] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.720gitlab # [ 5.828629] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 5.830005] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki722gitlab # [ 5.832944] systemd[1]: Listening on Disk Repartitioning Service Socket.723gitlab # [ 5.834015] systemd[1]: Listening on udev Control Socket.724gitlab # [ 5.834972] systemd[1]: Listening on udev Varlink Socket.725gitlab # [ 5.838304] systemd[1]: Mounting Huge Pages File System...726gitlab # [ 5.840431] systemd[1]: Mounting POSIX Message Queue File System...727gitlab # [ 5.842448] systemd[1]: Mounting Kernel Debug File System...728gitlab # [ 5.846475] systemd[1]: Mounting Kernel Trace File System...729gitlab # [ 5.853735] systemd[1]: Starting Create List of Static Device Nodes...730gitlab # [ 5.854737] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio731gitlab # [ 5.860565] systemd[1]: Starting Load Kernel Module configfs...732gitlab # [ 5.863147] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm733gitlab # [ 5.866745] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore734gitlab # [ 5.870817] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse735gitlab # [ 5.881847] systemd[1]: Mounting FUSE Control File System...736gitlab # [ 5.884267] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67737gitlab # [ 5.894102] systemd[1]: Starting Journal Service...738gitlab # [ 5.898912] systemd[1]: Starting Load Kernel Modules...739gitlab # [ 5.918460] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...740gitlab # [ 5.923091] systemd[1]: Starting Remount Root and Kernel File Systems...741gitlab # [ 5.925735] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os742gitlab # [ 5.933624] systemd[1]: Starting Coldplug All udev Devices...743gitlab # [ 5.942355] systemd[1]: Listening on Journal Log Access Socket.744gitlab # [ 5.942936] loop: module loaded745gitlab # [ 5.948722] systemd-journald[317]: Collecting audit messages is enabled.746gitlab # [ 5.962295] systemd[1]: Mounted Huge Pages File System.747gitlab # [ 5.962499] systemd[1]: Mounted POSIX Message Queue File System.748gitlab # [ 5.964500] EXT4-fs (vda): re-mounted c48dca42-7b3c-46f9-8ddc-94b8c0079a1f.749gitlab # [ 5.967898] systemd[1]: Mounted Kernel Debug File System.750gitlab # [ 5.969025] systemd[1]: Mounted Kernel Trace File System.751gitlab # [ 5.821298] systemd[1]: Queued start job for default target Multi-User System.752gitlab # [ 5.971035] systemd[1]: Started Journal Service.753gitlab # [ 5.823760] systemd[1]: Unnecessary job was removed for /dev/vdb.754gitlab # [ 5.824975] systemd[1]: systemd-journald.service: Deactivated successfully.755gitlab # [ 5.826457] systemd-modules-load[318]: Using 3 probe threads756gitlab # [ 5.827541] systemd-modules-load[318]: Inserted module 'loop'757gitlab # [ 5.828570] systemd-modules-load[318]: Inserted module 'tls'758gitlab # [ 5.829594] systemd[1]: Finished Create List of Static Device Nodes.759gitlab # [ 5.830666] systemd[1]: modprobe@configfs.service: Deactivated successfully.760gitlab # [ 5.831824] systemd[1]: Finished Load Kernel Module configfs.761gitlab # [ 5.832855] systemd[1]: Mounted FUSE Control File System.762gitlab # [ 5.833792] systemd[1]: Finished Load Kernel Modules.763gitlab # [ 5.835189] systemd[1]: Finished Remount Root and Kernel File Systems.764gitlab # [ 5.836317] systemd-oomd[320]: No swap; memory pressure usage will be degraded765gitlab # [ 5.837612] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.766gitlab # [ 5.844394] systemd[1]: Listening on Disk Image Download Service Socket.767gitlab # [ 5.846542] systemd[1]: Mounting Kernel Configuration File System...768gitlab # [ 5.849240] systemd[1]: Starting Firewall...769gitlab # [ 5.850458] systemd[1]: Starting Flush Journal to Persistent Storage...770gitlab # [ 5.851531] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 5.862265] systemd[1]: Starting Load/Save OS Random Seed...772gitlab # [ 6.015794] systemd-journald[317]: Received client request to flush runtime journal.773gitlab # [ 5.907060] systemd[1]: Starting Apply Kernel Variables...774gitlab # [ 5.908722] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...775gitlab # [ 5.910022] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776gitlab # [ 5.911415] systemd[1]: Mounted Kernel Configuration File System.777gitlab # [ 5.912415] systemd[1]: Finished Load/Save OS Random Seed.778gitlab # [ 5.913252] systemd[1]: Reached target First Boot Complete.779gitlab # [ 5.914069] systemd[1]: Finished Apply Kernel Variables.780gitlab # [ 5.914808] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.781gitlab # [ 5.915763] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 5.916687] systemd[1]: Finished Flush Journal to Persistent Storage.783gitlab # [ 5.927798] systemd[1]: Finished Create Static Device Nodes in /dev.784gitlab # [ 5.928831] systemd[1]: Reached target Preparation for Local File Systems.785gitlab # [ 5.931142] systemd[1]: Starting Rule-based Manager for Device Events and Files...786gitlab # [ 5.956993] systemd-udevd[373]: Using default interface naming scheme 'v261'.787gitlab # [ 5.958943] systemd[1]: Finished Coldplug All udev Devices.788gitlab # [ 5.985708] systemd[1]: Started Rule-based Manager for Device Events and Files.789gitlab # [ 6.053725] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse790gitlab # [ 6.081553] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.791gitlab # [ 6.083729] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.792gitlab # [ 6.095164] systemd[1]: Finished Firewall.793gitlab # [ 6.111621] (udev-worker)[442]: Network interface NamePolicy= disabled on kernel command line.794gitlab # [ 6.117390] (udev-worker)[437]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.119605] (udev-worker)[437]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.295213] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console797gitlab # [ 6.153730] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 6.302261] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3799gitlab # [ 6.302728] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0800gitlab # [ 6.168775] s[ 6.302786] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD801gitlab # ystemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore802gitlab # [ 6.309698] ACPI: button: Power Button [PWRF]803gitlab # [ 6.315720] Console: switching to colour dummy device 80x25804gitlab # [ 6.320696] [drm] Found bochs VGA, ID 0xb0c5.805gitlab # [ 6.320699] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.806gitlab # [ 6.322219] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic807gitlab # [ 6.173874] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67808gitlab # [ 6.325188] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0809gitlab # [ 6.176831] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore810gitlab # [ 6.327962] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5811gitlab # [ 6.179687] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os812gitlab # [ 6.182378] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os813gitlab # [ 6.332193] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4814gitlab # [ 6.332200] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6815gitlab # [ 6.350846] Console: switching to colour frame buffer device 160x50816gitlab # [ 6.352266] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device817gitlab # [ 6.355716] Floppy drive(s): fd0 is 2.88M AMI BIOS818gitlab # [ 6.362925] rtc_cmos 00:05: RTC can wake from S4819gitlab # [ 6.363931] parport_pc 00:03: reported by Plug and Play ACPI820gitlab # [ 6.365041] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]821gitlab # [ 6.366851] FDC 0 is a S82078B822gitlab # [ 6.374630] rtc_cmos 00:05: registered as rtc0823gitlab # [ 6.375202] rtc_cmos 00:05: setting system clock to 2026-10-02T14:10:01 UTC (1790950201)824gitlab # [ 6.376299] systemd-journald[317]: Time jumped backwards, rotating.825gitlab # [ 6.377321] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 6.408178] mousedev: PS/2 mouse device common for all mice827gitlab # [ 6.300161] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 6.313550] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.829gitlab # [ 6.321462] systemd[1]: Stopped Virtual Console Setup.830gitlab # [ 6.335183] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.499327] ppdev: user-space parallel port driver832gitlab # [ 6.539482] kvm_amd: TSC scaling supported833gitlab # [ 6.540088] kvm_amd: Nested Virtualization enabled834gitlab # [ 6.540860] kvm_amd: Nested Paging enabled835gitlab # [ 6.541480] kvm_amd: LBR virtualization supported836gitlab # [ 6.542138] kvm_amd: Virtual VMLOAD VMSAVE supported837gitlab # [ 6.542860] kvm_amd: Virtual GIF supported838gitlab # [ 6.543551] kvm_amd: Virtual NMI enabled839gitlab # [ 6.408369] systemd-vconsole-setup[492]: Configuration of first virtual console was skipped, ignoring remaining ones.840gitlab # [ 6.411392] systemd[1]: Finished Virtual Console Setup.841gitlab # [ 6.577087] EDAC MC: Ver: 3.0.0842gitlab # [ 6.648769] systemd[1]: Mounting /run/wrappers...843gitlab # [ 6.684694] systemd[1]: Mounted /run/wrappers.844gitlab # [ 6.686817] systemd[1]: Reached target Local File Systems.845gitlab # [ 6.688794] systemd[1]: Listening on Boot Loader Control Service Socket.846gitlab # [ 6.691138] systemd[1]: Starting register-nix-paths.service...847gitlab # [ 6.693525] systemd[1]: Starting Create SUID/SGID Wrappers...848gitlab # [ 6.695554] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.849gitlab # [ 6.698570] systemd[1]: Starting Save Transient machine-id to Disk...850gitlab # [ 6.704220] systemd[1]: Starting Create System Files and Directories...851gitlab # [ 6.736907] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.852gitlab # [ 6.742447] systemd[1]: Finished Save Transient machine-id to Disk.853gitlab # [ 6.751056] systemd[1]: Finished Create System Files and Directories.854gitlab # [ 6.756073] systemd[1]: Starting Rebuild Journal Catalog...855gitlab # [ 6.758925] systemd[1]: Starting Record System Boot/Shutdown in UTMP...856gitlab # [ 6.777804] systemd[1]: Finished Record System Boot/Shutdown in UTMP.857gitlab # [ 6.803223] systemd[1]: Finished Rebuild Journal Catalog.858gitlab # [ 6.805944] systemd[1]: Starting Update is Completed...859gitlab # [ 6.828396] systemd[1]: Finished Update is Completed.860gitlab # [ 6.849965] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.861gitlab # [ 6.851659] systemd[1]: Finished Create SUID/SGID Wrappers.862gitlab # [ 7.126754] systemd[1]: Finished register-nix-paths.service.863gitlab # [ 7.128339] systemd[1]: Reached target System Initialization.864gitlab # [ 7.129695] systemd[1]: Started Discard unused filesystem blocks once a week.865gitlab # [ 7.131240] systemd[1]: Started logrotate.timer.866gitlab # [ 7.132440] systemd[1]: Started Daily Cleanup of Temporary Directories.867gitlab # [ 7.133836] systemd[1]: Reached target Timer Units.868gitlab # [ 7.135152] systemd[1]: Listening on D-Bus System Message Bus Socket.869gitlab # [ 7.136502] systemd[1]: Listening on Nix Daemon Socket.870gitlab # [ 7.139301] systemd[1]: Starting nixbot CI service socket...871gitlab # [ 7.140613] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.872gitlab # [ 7.142351] systemd[1]: Listening on nixbot CI service socket.873gitlab # [ 7.143845] systemd[1]: Reached target Socket Units.874gitlab # [ 7.148359] systemd[1]: Starting D-Bus System Message Bus...875gitlab # [ 7.216485] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'...876gitlab # [ 7.219685] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync'877gitlab # [ 7.222479] dbus-broker-launch[574]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"878gitlab # [ 7.227720] systemd[1]: Started D-Bus System Message Bus.879gitlab # [ 7.248810] dbus-broker-launch[574]: Ready880gitlab # [ 7.253285] systemd[1]: Reached target Basic System.881gitlab # [ 7.256289] systemd[1]: Started backdoor.service.882gitlab # [ 7.259277] systemd[1]: Starting gitlab-config.service...883gitlab # [ 7.264151] systemd[1]: Starting Import lastlog data into lastlog2 database...884gitlab # [ 7.277167] systemd[1]: Starting Logrotate configuration check...885gitlab # [ 7.285591] systemd[1]: Starting Name Service Cache Daemon (nsncd)...886gitlab # [ 7.298205] systemd[1]: Starting Post-Boot Actions...887gitlab # [ 7.303507] systemd[1]: Started Reset console on configuration changes.888gitlab # connecting to host...889gitlab # [ 7.311118] systemd[1]: Starting resolvconf update...890gitlab # [ 7.312746] logrotate[579]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.891gitlab # [ 7.313917] logrotate[579]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf892gitlab # [ 7.316381] logrotate[579]: note: 'monthly' overrides previously specified 'weekly'893gitlab # [ 7.320159] logrotate[579]: Reading state from file: /var/lib/logrotate.status894gitlab # [ 7.320608] logrotate[579]: state file /var/lib/logrotate.status does not exist895gitlab # [ 7.321567] logrotate[579]: Allocating hash table for state file, size 64 entries896gitlab # [ 7.322887] logrotate[579]: Handling 4 logs897gitlab # [ 7.324142] logrotate[579]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed898gitlab # [ 7.325061] logrotate[579]: considering log /var/log/btmp899gitlab # [ 7.326080] logrotate[579]: Creating new state900gitlab # [ 7.326691] logrotate[579]: Now: 2026-10-02 14:10901gitlab # [ 7.327927] logrotate[579]: Last rotated at 2026-10-02 14:00902gitlab # [ 7.328645] logrotate[579]: log does not need rotating (log has already been rotated)903gitlab # [ 7.329488] logrotate[579]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab # [ 7.330196] logrotate[579]: considering log /var/log/wtmp905gitlab # [ 7.330676] logrotate[579]: Creating new state906gitlab # [ 7.331245] logrotate[579]: Now: 2026-10-02 14:10907gitlab # [ 7.331683] logrotate[579]: Last rotated at 2026-10-02 14:00908gitlab # [ 7.332210] logrotate[579]: log does not need rotating (log has already been rotated)909gitlab # [ 7.332650] logrotate[579]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed910gitlab # [ 7.333197] logrotate[579]: switching euid from 0 to 165 and egid from 0 to 165 (pid 579)911gitlab # [ 7.333639] logrotate[579]: considering log /var/gitlab/state/log/*.log912gitlab # [ 7.334163] logrotate[579]: log /var/gitlab/state/log/*.log does not exist -- skipping913gitlab # [ 7.334607] logrotate[579]: Creating new state914gitlab # [ 7.335102] logrotate[579]: switching euid from 165 to 0 and egid from 165 to 0 (pid 579)915gitlab # [ 7.335565] logrotate[579]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed916gitlab # [ 7.336056] logrotate[579]: switching euid from 0 to 60 and egid from 0 to 60 (pid 579)917gitlab # [ 7.336523] logrotate[579]: considering log /var/log/nginx/*.log918gitlab # [ 7.336971] logrotate[579]: log /var/log/nginx/*.log does not exist -- skipping919gitlab # [ 7.337618] logrotate[579]: Creating new state920gitlab # [ 7.338116] logrotate[579]: not running postrotate script, since no logs were rotated921gitlab # [ 7.338575] logrotate[579]: switching euid from 60 to 0 and egid from 60 to 0 (pid 579)922gitlab: Guest shell says: b'Spawning backdoor root shell...\n'923gitlab: connected to guest root shell924gitlab: (connecting took 7.95 seconds)925gitlab: (finished: waiting for the VM to finish booting, in 7.95 seconds)926gitlab # [ 7.360809] systemd[1]: Finished Logrotate configuration check.927gitlab # [ 7.363816] systemd[1]: Finished Post-Boot Actions.928gitlab # [ 7.368855] systemd[1]: Finished Import lastlog data into lastlog2 database.929gitlab # [ 7.375535] systemd[1]: Started Name Service Cache Daemon (nsncd).930gitlab # [ 7.376754] nsncd[580]: Oct 02 14:10:02.649 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"931gitlab # [ 7.377825] systemd[1]: Reached target Host and Network Name Lookups.932gitlab # [ 7.378805] systemd[1]: Reached target User and Group Name Lookups.933gitlab # [ 7.380107] systemd[1]: Starting User Login Management...934gitlab # [ 7.417448] systemd[1]: Stopped target Host and Network Name Lookups.935gitlab # [ 7.418797] systemd[1]: Stopping Host and Network Name Lookups...936gitlab # [ 7.419487] systemd[1]: Stopped target User and Group Name Lookups.937gitlab # [ 7.419921] systemd[1]: Stopping User and Group Name Lookups...938gitlab # [ 7.420603] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...939gitlab # [ 7.422616] systemd[1]: nscd.service: Deactivated successfully.940gitlab # [ 7.423544] systemd[1]: Stopped Name Service Cache Daemon (nsncd).941gitlab # [ 7.425528] systemd-logind[616]: New seat seat0.942gitlab # [ 7.426302] systemd[1]: nscd.service: Consumed 28ms CPU time over 137ms wall clock time, 7.3M memory peak, 5.5M read from disk.943gitlab # [ 7.428203] systemd-logind[616]: Watching system buttons on /dev/input/event2 (Power Button)944gitlab # [ 7.430595] systemd-logind[616]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)945gitlab # [ 7.431802] systemd-logind[616]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)946gitlab # [ 7.433185] systemd[1]: Started User Login Management.947gitlab # [ 7.433906] systemd[1]: Starting linger-users.service...948gitlab # [ 7.434687] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.447951] nsncd[672]: Oct 02 14:10:02.720 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"950gitlab # [ 7.448716] systemd[1]: Started Name Service Cache Daemon (nsncd).951gitlab # [ 7.449229] systemd[1]: linger-users.service: Deactivated successfully.952gitlab # [ 7.449654] systemd[1]: Finished linger-users.service.953gitlab # [ 7.450159] systemd[1]: Reached target Host and Network Name Lookups.954gitlab # [ 7.450613] systemd[1]: Reached target User and Group Name Lookups.955gitlab # [ 7.453811] systemd[1]: Finished resolvconf update.956gitlab # [ 7.455110] systemd[1]: Reached target Preparation for Network.957gitlab # [ 7.457353] systemd[1]: Starting DHCP Client...958gitlab # [ 7.458465] systemd[1]: Starting Address configuration of eth1...959gitlab # [ 7.461163] systemd[1]: Starting Extra networking commands....960gitlab # [ 7.501607] network-addresses-eth1-start[697]: adding address 192.168.1.1/24... done961gitlab # [ 7.504123] network-addresses-eth1-start[697]: adding address 2001:db8:1::1/64... done962gitlab # [ 7.509515] systemd[1]: Finished Address configuration of eth1.963gitlab # [ 7.534217] systemd[1]: Finished Extra networking commands..964gitlab # [ 7.536157] systemd[1]: Reached target Network.965gitlab # [ 7.538076] systemd[1]: Starting gitlab-workhorse.service...966gitlab # [ 7.538893] dhcpcd[706]: dhcpcd-10.3.2 starting967gitlab # [ 7.540926] dhcpcd[763]: dev: loaded udev968gitlab # [ 7.541597] systemd[1]: Starting Nginx Web Server...969gitlab # [ 7.543776] systemd[1]: Starting PostgreSQL Server...970gitlab # [ 7.545507] systemd[1]: Starting Redis Server - redis-gitlab...971gitlab # [ 7.696532] 8021q: 802.1Q VLAN Support v1.8972gitlab # [ 7.697047] 8021q: adding VLAN 0 to HW filter on device eth1973gitlab # [ 7.549490] systemd[1]: Starting Permit User Sessions...974gitlab # [ 7.562077] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.975gitlab # [ 7.568335] systemd[1]: Finished Permit User Sessions.976gitlab # [ 7.575212] systemd[1]: Started Getty on tty1.977gitlab # [ 7.576634] systemd[1]: Reached target Login Prompts.978gitlab # [ 7.787587] cfg80211: Loading compiled-in X.509 certificates for regulatory database979gitlab # [ 7.791782] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'980gitlab # [ 7.792616] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'981gitlab # [ 7.794763] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2982gitlab # [ 7.796041] cfg80211: failed to load regulatory.db983gitlab # [ 7.665871] nginx-pre-start[787]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok984gitlab # [ 7.666591] nginx-pre-start[787]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful985gitlab # [ 7.670649] redis-server[785]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.986gitlab # [ 7.822140] 8021q: adding VLAN 0 to HW filter on device eth0987gitlab # [ 7.675193] redis-server[785]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo988gitlab # [ 7.676763] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.678251] redis-server[785]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=785, just started990gitlab # [ 7.679866] redis-server[785]: Configuration loaded991gitlab # [ 7.680871] systemd[1]: Started Redis Server - redis-gitlab.992gitlab # [ 7.681905] redis[785]: monotonic clock: POSIX clock_gettime993gitlab # [ 7.683049] redis[785]: Running mode=standalone, port=0.994gitlab # [ 7.684259] dhcpcd[763]: eth0: waiting for carrier995gitlab # [ 7.685122] dhcpcd[763]: eth0: carrier acquired996gitlab # [ 7.685960] redis[785]: Server initialized997gitlab # [ 7.686879] redis[785]: Ready to accept connections unix998gitlab # [ 7.688042] redis[785]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.999gitlab # [ 7.689951] dhcpcd[763]: DUID 00:01:00:01:32:52:77:ba:52:54:00:12:34:561000gitlab # [ 7.690926] dhcpcd[763]: eth0: IAID 00:12:34:561001gitlab # [ 7.691700] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:34561002gitlab # [ 7.703588] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".1003gitlab # [ 7.704369] postgresql-pre-start[791]: This user must also own the server process.1004gitlab # [ 7.708914] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".1005gitlab # [ 7.709518] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".1006gitlab # [ 7.710060] postgresql-pre-start[791]: The default text search configuration will be set to "english".1007gitlab # [ 7.710506] postgresql-pre-start[791]: Data page checksums are enabled.1008gitlab # [ 7.711031] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1009gitlab # [ 7.711568] postgresql-pre-start[791]: creating subdirectories ... ok1010gitlab # [ 7.712121] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix1011gitlab # [ 7.741228] postgresql-pre-start[791]: selecting default "max_connections" ... 1001012gitlab # [ 7.784580] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB1013gitlab # [ 8.046320] systemd[1]: Started gitlab-workhorse.service.1014gitlab # [ 8.174598] postgresql-pre-start[791]: selecting default time zone ... UTC1015gitlab # [ 8.177735] postgresql-pre-start[791]: creating configuration files ... ok1016gitlab # [ 8.244405] gitlab-workhorse[821]: time="2026-10-02T14:10:03Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41017gitlab # [ 8.245198] gitlab-workhorse[821]: time="2026-10-02T14:10:03Z" level=info msg="Using redis/go-redis"1018gitlab # [ 8.245668] gitlab-workhorse[821]: time="2026-10-02T14:10:03Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1019gitlab # [ 8.362530] postgresql-pre-start[791]: running bootstrap script ... ok1020gitlab # [ 8.802872] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok1021gitlab # [ 9.049419] postgresql-pre-start[791]: syncing data to disk ... ok1022gitlab # [ 9.051397] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections1023gitlab # [ 9.053101] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1024gitlab # [ 9.054283] postgresql-pre-start[791]: Success. You can now start the database server using:1025gitlab # [ 9.055456] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1026gitlab # [ 9.171615] postgres[847]: [847] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1027gitlab # [ 9.175458] postgres[847]: [847] LOG: listening on IPv6 address "::1", port 54321028gitlab # [ 9.177763] postgres[847]: [847] LOG: listening on IPv4 address "127.0.0.1", port 54321029gitlab # [ 9.184920] postgres[847]: [847] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1030gitlab # [ 9.206501] postgres[857]: [857] LOG: database system was shut down at 2026-10-02 14:10:04 GMT1031gitlab # [ 9.216072] postgres[847]: [847] LOG: database system is ready to accept connections1032gitlab # [ 9.222352] systemd[1]: Started PostgreSQL Server.1033gitlab # [ 9.228729] systemd[1]: Starting PostgreSQL Setup Scripts...1034gitlab # [ 9.398532] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[865]: mkdir -p /var/gitlab/state/home/.ssh: OK1035gitlab # [ 9.401212] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[865]: chmod 700 /var/gitlab/state/home/.ssh: OK1036gitlab # [ 9.451911] postgresql-setup-start[873]: CREATE DATABASE1037gitlab # [ 9.463678] systemd[1]: Finished gitlab-config.service.1038gitlab # [ 9.471141] systemd[1]: Started gitaly.service.1039gitlab # [ 9.480380] postgresql-setup-start[895]: CREATE ROLE1040gitlab # [ 9.494902] postgresql-setup-start[902]: ALTER DATABASE1041gitlab # [ 9.511458] postgresql-setup-start[908]: CREATE ROLE1042gitlab # [ 9.513504] systemd[1]: Finished PostgreSQL Setup Scripts.1043gitlab # [ 9.514254] systemd[1]: Reached target PostgreSQL.1044gitlab # [ 9.515390] systemd[1]: Starting gitlab-db-config.service...1045gitlab # [ 9.516653] systemd[1]: Starting gitlab-postgresql.service...1046gitlab # [ 9.567828] dhcpcd[763]: eth0: soliciting a DHCP lease1047gitlab # [ 9.721233] NET: Registered PF_PACKET protocol family1048gitlab # [ 9.579546] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.21049gitlab # [ 9.582224] dhcpcd[763]: eth0: probing address 10.0.2.15/241050gitlab # [ 9.619375] gitlab-postgresql-start[918]: CREATE DATABASE1051gitlab # [ 9.646230] gitlab-postgresql-start[925]: CREATE EXTENSION1052gitlab # [ 9.724747] gitlab-postgresql-start[932]: CREATE EXTENSION1053gitlab # [ 9.727241] systemd[1]: Finished gitlab-postgresql.service.1054gitlab # [ 9.986621] gitaly[894]: time="2026-10-02T14:10:05.258Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8941055gitlab # [ 9.987804] gitaly[894]: time="2026-10-02T14:10:05.259Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8941056gitlab # [ 9.991417] gitaly[894]: time="2026-10-02T14:10:05.259Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8941057gitlab # [ 9.992514] gitaly[894]: time="2026-10-02T14:10:05.259Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8941058gitlab # [ 9.995238] gitaly[894]: time="2026-10-02T14:10:05.259Z" level=info msg="Starting Gitaly" pid=894 version=1059gitlab # [ 10.158895] gitaly[894]: time="2026-10-02T14:10:05.431Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=172 pid=8941060gitlab # [ 10.159716] gitaly[894]: time="2026-10-02T14:10:05.432Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8941061gitlab # [ 10.160433] gitaly[894]: time="2026-10-02T14:10:05.432Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8941062gitlab # [ 10.160847] gitaly[894]: time="2026-10-02T14:10:05.432Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-894/git-exec-1403398275.d/git pid=8941063gitlab # [ 10.168139] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="finished detecting git version" duration_ms=8 pid=8941064gitlab # [ 10.168752] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="using Git version" pid=894 version=2.53.g1065gitlab # [ 10.169489] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="clearing disk cache object folder" pid=894 storage=default1066gitlab # [ 10.169843] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache381236104 pid=894 storage=default1067gitlab # [ 10.170507] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache381236104 pid=894 storage=default1068gitlab # [ 10.171027] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8941069gitlab # [ 10.171499] gitaly[894]: time="2026-10-02T14:10:05.441Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8941070gitlab # [ 10.171930] gitaly[894]: time="2026-10-02T14:10:05.442Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache381236104 clear_duration_ms=0 pid=894 storage=default1071gitlab # [ 10.202448] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8941072gitlab # [ 10.203168] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=info msg="finished tempdir cleaner walk" pid=894 storage=default time_ms=01073gitlab # [ 10.203967] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=894 schema=unix1074gitlab # [ 10.204297] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=info msg="counting repositories" pid=8941075gitlab # [ 10.204781] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=info msg="starting to count repositories" pid=894 storage_path=/var/gitlab/state/repositories1076gitlab # [ 10.205446] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=894 storage_path=/var/gitlab/state/repositories1077gitlab # [ 10.205912] gitaly[894]: time="2026-10-02T14:10:05.476Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8941078gitlab # [ 10.206536] gitaly[894]: time="2026-10-02T14:10:05.475Z" level=info msg="listening at address" address=/run/gitaly/gitaly-894/sock.d/intern pid=894 schema=unix1079gitlab # [ 10.216270] gitaly[894]: time="2026-10-02T14:10:05.489Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8941080gitlab # [ 10.216930] gitaly[894]: time="2026-10-02T14:10:05.489Z" level=info msg="Started Gitaly" duration_ms=230 pid=8941081gitlab # [ 10.217439] gitaly[894]: time="2026-10-02T14:10:05.489Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8941082gitlab # [ 10.217943] gitaly[894]: time="2026-10-02T14:10:05.489Z" level=info msg="maintenance: daily scheduled" pid=894 scheduled="2026-10-03 12:00:00 +0000 UTC"1083gitlab # [ 10.246103] dhcpcd[763]: eth0: soliciting an IPv6 router1084gitlab # [ 10.247183] dhcpcd[763]: eth0: Router Advertisement from fe80::21085gitlab # [ 10.248379] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/641086gitlab # [ 10.249189] dhcpcd[763]: eth0: adding route to fec0::/641087gitlab # [ 10.249658] dhcpcd[763]: eth0: adding default route via fe80::21088gitlab # [ 11.123090] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[913]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1089gitlab # [ 11.124306] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[913]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1090gitlab # [ 11.164966] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[913]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1091gitlab # [ 12.161899] gitaly[894]: time="2026-10-02T14:10:07.434Z" level=info msg="License database preloaded" duration_ms=2174 pid=8941092gitlab # [ 14.752769] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds1093gitlab # [ 14.754964] dhcpcd[763]: eth0: adding route to 10.0.2.0/241094gitlab # [ 14.756870] dhcpcd[763]: eth0: adding default route via 10.0.2.21095gitlab # [ 14.878307] systemd[1]: Started DHCP Client.1096gitlab # [ 14.881107] systemd[1]: Reached target Network is Online.1097gitlab # [ 40.165291] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[913]: W, [2026-10-02T14:10:35.437954 #913] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1098gitlab # [ 42.156086] postgres[1307]: [1307] ERROR: relation "feature_gates" does not exist at character 5231099gitlab # [ 42.157453] postgres[1307]: [1307] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1100gitlab # [ 42.158625] postgres[1307]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1101gitlab # [ 42.159843] postgres[1307]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1102gitlab # [ 42.161037] postgres[1307]: attidentity AS identity,1103gitlab # [ 42.161808] postgres[1307]: attgenerated as attgenerated1104gitlab # [ 42.162631] postgres[1307]: FROM pg_attribute a1105gitlab # [ 42.163353] postgres[1307]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1106gitlab # [ 42.164542] postgres[1307]: LEFT JOIN pg_type t ON a.atttypid = t.oid1107gitlab # [ 42.165441] postgres[1307]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1108gitlab # [ 42.166769] postgres[1307]: WHERE a.attrelid = '"feature_gates"'::regclass1109gitlab # [ 42.167715] postgres[1307]: AND a.attnum > 0 AND NOT a.attisdropped1110gitlab # [ 42.168592] postgres[1307]: ORDER BY a.attnum1111gitlab # [ 42.169275] postgres[1307]:1112gitlab # [ 45.465482] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1340]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1113gitlab # [ 45.467505] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1340]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1114gitlab # [ 48.284093] gitlab-workhorse[821]: time="2026-10-02T14:10:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1115gitlab # [ 58.285764] gitlab-workhorse[821]: time="2026-10-02T14:10:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1116gitlab # [ 60.204683] postgres[1406]: [1406] ERROR: relation "table_without_models" does not exist1117gitlab # [ 60.207113] postgres[1406]: [1406] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1118gitlab # [ 68.286285] gitlab-workhorse[821]: time="2026-10-02T14:11:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 72.106826] systemd[1]: Finished gitlab-db-config.service.1120gitlab # [ 72.113140] systemd[1]: Started gitlab-sidekiq.service.1121gitlab # [ 72.116782] systemd[1]: Starting gitlab.service...1122gitlab # [ 72.468581] bundle[1573]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1123gitlab # [ 72.470298] bundle[1573]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1124gitlab # [ 72.471946] bundle[1573]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1125gitlab # [ 75.042654] sidekiq-cluster[1572]: {"severity":"INFO","time":"2026-10-02T14:11:10.299Z","message":"Starting cluster with 1 processes"}1126gitlab # [ 75.204348] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.454Z","pid":1573,"message":"* Enabling systemd notification integration"}1127gitlab # [ 75.205426] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"Puma starting in cluster mode..."}1128gitlab # [ 75.206347] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1129gitlab # [ 75.207241] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1130gitlab # [ 75.207921] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Min threads: 0"}1131gitlab # [ 75.208726] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Max threads: 4"}1132gitlab # [ 75.209865] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Environment: production"}1133gitlab # [ 75.210766] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Master PID: 1573"}1134gitlab # [ 75.211459] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.476Z","pid":1573,"message":"* Workers: 2"}1135gitlab # [ 75.212226] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.477Z","pid":1573,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1136gitlab # [ 75.212843] bundle[1573]: {"timestamp":"2026-10-02T14:11:10.477Z","pid":1573,"message":"* Preloading application"}1137gitlab # [ 78.295551] gitlab-workhorse[821]: time="2026-10-02T14:11:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1138gitlab # [ 88.304754] gitlab-workhorse[821]: time="2026-10-02T14:11:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1139gitlab # [ 97.057481] bundle[1573]: W, [2026-10-02T14:11:32.329688 #1573] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1140gitlab # [ 98.314757] gitlab-workhorse[821]: time="2026-10-02T14:11:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 99.141711] sidekiq-cluster[1603]: 2026-10-02T14:11:34.413Z pid=1603 tid=wkr INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1603, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>436285440}1142gitlab # [ 99.303170] sidekiq-cluster[1603]: W, [2026-10-02T14:11:34.575922 #1603] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1143gitlab # [ 99.340136] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:34.612Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1144gitlab # [ 101.120835] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.393Z","message":"GitLab reliable fetch activated!"}1145gitlab # [ 101.122382] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.393Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1146gitlab # [ 101.160089] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.433Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1147gitlab # [ 101.168916] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.441Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1148gitlab # [ 101.177798] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.450Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1149gitlab # [ 101.186590] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.459Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1150gitlab # [ 101.196143] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.469Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1151gitlab # [ 101.205211] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.478Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 101.213663] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.486Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1153gitlab # [ 101.221494] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.494Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1154gitlab # [ 101.229709] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.502Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1155gitlab # [ 101.238090] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.511Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1156gitlab # [ 101.246628] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.519Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1157gitlab # [ 101.256096] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.529Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1158gitlab # [ 101.264129] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.537Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1159gitlab # [ 101.272530] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.545Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1160gitlab # [ 101.281931] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.554Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1161gitlab # [ 101.290489] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.563Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1162gitlab # [ 101.297250] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.570Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1163gitlab # [ 101.303264] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.576Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1164gitlab # [ 101.309562] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.582Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1165gitlab # [ 101.315762] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.588Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1166gitlab # [ 101.321657] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.594Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1167gitlab # [ 101.326438] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.599Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1168gitlab # [ 101.331659] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.604Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1169gitlab # [ 101.337788] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.610Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1170gitlab # [ 101.342887] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.615Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1171gitlab # [ 101.348416] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.621Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1172gitlab # [ 101.354099] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.627Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1173gitlab # [ 101.359371] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.632Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1174gitlab # [ 101.364997] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.638Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1175gitlab # [ 101.370463] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.643Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1176gitlab # [ 101.375097] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.648Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1177gitlab # [ 101.378912] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.652Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1178gitlab # [ 101.382553] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.655Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1179gitlab # [ 101.386108] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.659Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1180gitlab # [ 101.389532] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.662Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1181gitlab # [ 101.392790] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.665Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1182gitlab # [ 101.396061] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.669Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1183gitlab # [ 101.399318] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.672Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1184gitlab # [ 101.402094] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.675Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1185gitlab # [ 101.404569] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.677Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1186gitlab # [ 101.407481] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.680Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1187gitlab # [ 101.410091] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.683Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1188gitlab # [ 101.412813] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.685Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1189gitlab # [ 101.415822] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.688Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1190gitlab # [ 101.418938] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.692Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1191gitlab # [ 101.421762] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.694Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1192gitlab # [ 101.424398] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.697Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1193gitlab # [ 101.427326] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.700Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1194gitlab # [ 101.430483] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.703Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1195gitlab # [ 101.433741] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.706Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1196gitlab # [ 101.436641] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.709Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1197gitlab # [ 101.467482] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.739Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1198gitlab # [ 101.475916] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.748Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1199gitlab # [ 101.480339] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.753Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1200gitlab # [ 101.484119] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.757Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1201gitlab # [ 101.488120] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.761Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1202gitlab # [ 101.491755] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.764Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1203gitlab # [ 101.495616] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.768Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1204gitlab # [ 101.498801] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.771Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1205gitlab # [ 101.501678] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.774Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1206gitlab # [ 101.505128] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.778Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1207gitlab # [ 101.507928] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.781Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1208gitlab # [ 101.510851] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.783Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1209gitlab # [ 101.514518] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.787Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1210gitlab # [ 101.517891] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.791Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1211gitlab # [ 101.520910] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.794Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1212gitlab # [ 101.523716] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.796Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1213gitlab # [ 101.526372] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.799Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1214gitlab # [ 101.529230] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.802Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1215gitlab # [ 101.531707] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.804Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1216gitlab # [ 101.534293] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.807Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1217gitlab # [ 101.537383] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.810Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1218gitlab # [ 101.539855] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.812Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1219gitlab # [ 101.542587] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.815Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1220gitlab # [ 101.545248] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.818Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1221gitlab # [ 101.547541] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.820Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1222gitlab # [ 101.550061] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.823Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1223gitlab # [ 101.551913] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.825Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1224gitlab # [ 101.554348] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.827Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1225gitlab # [ 101.556231] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.829Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1226gitlab # [ 101.558234] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.831Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1227gitlab # [ 101.560419] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.833Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1228gitlab # [ 101.562741] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.835Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1229gitlab # [ 101.565707] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.838Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1230gitlab # [ 101.568023] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.841Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1231gitlab # [ 101.569911] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.843Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1232gitlab # [ 101.572097] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.845Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1233gitlab # [ 101.574229] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.847Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1234gitlab # [ 101.576624] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.849Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1235gitlab # [ 101.578517] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.851Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1236gitlab # [ 101.580774] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.853Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1237gitlab # [ 101.582796] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.855Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1238gitlab # [ 101.584692] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.857Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1239gitlab # [ 101.587247] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.860Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1240gitlab # [ 101.589568] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.862Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1241gitlab # [ 101.592327] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.865Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1242gitlab # [ 101.594242] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.867Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1243gitlab # [ 101.596212] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.869Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1244gitlab # [ 101.605096] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.878Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1245gitlab # [ 101.606991] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.880Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1246gitlab # [ 101.609343] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.882Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1247gitlab # [ 101.612156] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.885Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1248gitlab # [ 101.614482] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.887Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1249gitlab # [ 101.616852] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.889Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1250gitlab # [ 101.619213] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.892Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1251gitlab # [ 101.621151] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.894Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1252gitlab # [ 101.623090] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.896Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1253gitlab # [ 101.625888] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.899Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1254gitlab # [ 101.627968] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:11:36.901Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1255gitlab # [ 103.700169] sidekiq-cluster[1603]: InitializerConnections Query: SET client_min_messages TO 'warning'1256gitlab # [ 103.705169] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1257gitlab # [ 103.705867] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1258gitlab # [ 103.706993] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1259gitlab # [ 103.707728] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1260gitlab # [ 103.708828] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1261gitlab # [ 103.709946] sidekiq-cluster[1603]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1262gitlab # [ 103.711773] sidekiq-cluster[1603]: InitializerConnections Query: SET standard_conforming_strings = on1263gitlab # [ 103.712941] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1264gitlab # [ 103.714130] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1265gitlab # [ 103.715240] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1266gitlab # [ 103.715952] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1267gitlab # [ 103.717139] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1268gitlab # [ 103.717848] sidekiq-cluster[1603]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1269gitlab # [ 103.744148] sidekiq-cluster[1603]: InitializerConnections Query: SET intervalstyle = iso_86011270gitlab # [ 103.744848] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1271gitlab # [ 103.745908] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1272gitlab # [ 103.751057] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1273gitlab # [ 103.752583] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1274gitlab # [ 103.755220] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1275gitlab # [ 103.756968] sidekiq-cluster[1603]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1276gitlab # [ 103.766062] sidekiq-cluster[1603]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1277gitlab # [ 103.767241] sidekiq-cluster[1603]: FROM pg_type as t1278gitlab # [ 103.768106] sidekiq-cluster[1603]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1279gitlab # [ 103.768975] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1280gitlab # [ 103.770252] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1281gitlab # [ 103.771684] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1282gitlab # [ 103.772880] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1283gitlab # [ 103.774143] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1284gitlab # [ 103.774978] sidekiq-cluster[1603]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1285gitlab # [ 103.786299] sidekiq-cluster[1603]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1286gitlab # [ 103.787184] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1287gitlab # [ 103.787865] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1288gitlab # [ 103.788742] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1289gitlab # [ 103.789394] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1290gitlab # [ 103.790081] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1291gitlab # [ 103.790693] sidekiq-cluster[1603]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1292gitlab # [ 103.798090] sidekiq-cluster[1603]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1293gitlab # [ 103.798728] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1294gitlab # [ 103.799213] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1295gitlab # [ 103.799662] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1296gitlab # [ 103.800211] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1297gitlab # [ 103.800643] sidekiq-cluster[1603]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1298gitlab # [ 103.801136] sidekiq-cluster[1603]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1299gitlab # [ 108.315836] gitlab-workhorse[821]: time="2026-10-02T14:11:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1300gitlab # [ 118.316874] gitlab-workhorse[821]: time="2026-10-02T14:11:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1301gitlab # [ 124.675534] postgres[2023]: [2023] ERROR: relation "table_without_models" does not exist1302gitlab # [ 124.678415] postgres[2023]: [2023] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1303gitlab # [ 127.164399] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:02.433Z","message":"Booted Rails 7.2.3.1 application in production environment"}1304gitlab # [ 127.165556] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:02.437Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1305gitlab # [ 127.166969] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:02.437Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1306gitlab # [ 127.168080] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:02.437Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1307gitlab # [ 127.168823] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:02.439Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1308gitlab # [ 127.256902] postgres[2052]: [2052] ERROR: relation "table_without_models" does not exist1309gitlab # [ 127.257680] postgres[2052]: [2052] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1310gitlab # [ 128.319442] gitlab-workhorse[821]: time="2026-10-02T14:12:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1311gitlab # [ 128.369421] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:03.641Z","message":"Cleaning working queues"}1312gitlab # [ 128.375133] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:03.647Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d5003f10f9efcc2ebb298394","created_at":"2026-10-02T14:11:07.024Z","trace_propagation_headers":{"sentry-trace":"6b05b83c14e744eabbe72ab6632eff8b-20e8e505b3b943f4","baggage":"sentry-trace_id=6b05b83c14e744eabbe72ab6632eff8b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d5e9984b8de22bc517da1ae137a27678","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T14:11:07.031Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d5003f10f9efcc2ebb298394: start","job_status":"start","queue_duration_s":56.616438,"scheduling_latency_s":56.616478}1313gitlab # [ 128.596933] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:03.869Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d5003f10f9efcc2ebb298394","created_at":"2026-10-02T14:11:07.024Z","trace_propagation_headers":{"sentry-trace":"6b05b83c14e744eabbe72ab6632eff8b-20e8e505b3b943f4","baggage":"sentry-trace_id=6b05b83c14e744eabbe72ab6632eff8b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d5e9984b8de22bc517da1ae137a27678","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T14:11:07.031Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d5003f10f9efcc2ebb298394: done: 0.221732 sec","job_status":"done","queue_duration_s":56.616438,"scheduling_latency_s":56.616478,"redis_calls":31,"redis_duration_s":0.009427,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.005935,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002117,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098598845,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.221732,"completed_at":"2026-10-02T14:12:03.869Z","load_balancing_strategy":"primary","db_duration_s":0.064363,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1314gitlab # [ 129.976541] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.248Z","pid":1573,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1315gitlab # [ 129.978581] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.248Z","pid":1573,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1316gitlab # [ 129.979969] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.248Z","pid":1573,"message":"! #\u003cThread:0x00007f072ddd9a60 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1317gitlab # [ 129.981594] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.249Z","pid":1573,"message":"! #\u003cThread:0x00007f072dfc3ba0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1318gitlab # [ 129.982991] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.249Z","pid":1573,"message":"Use Ctrl-C to stop"}1319gitlab # [ 129.984175] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.249Z","pid":1573,"message":"Sending status to systemd every 1.0 sec"}1320gitlab # [ 130.715640] bundle[1573]: {"timestamp":"2026-10-02T14:12:05.988Z","pid":1573,"message":"- Worker 0 (PID: 2145) booted in 0.66s, phase: 0"}1321gitlab # [ 130.731413] bundle[1573]: {"timestamp":"2026-10-02T14:12:06.004Z","pid":1573,"message":"- Worker 1 (PID: 2151) booted in 0.65s, phase: 0"}1322gitlab # [ 130.738249] systemd[1]: Started gitlab.service.1323gitlab # [ 130.738769] systemd[1]: Reached target Common target for all GitLab services..1324gitlab # [ 130.742910] systemd[1]: Starting setup-gitlab.service...1325gitlab # [ 130.764038] setup-gitlab-start[2180]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1326gitlab # [ 132.705492] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:12:07 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 19141327gitlab # [ 132.709378] setup-gitlab-start[2180]: + TOKEN=nixbot-test-token-of-20-chars1328gitlab # [ 132.710432] setup-gitlab-start[2180]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1329gitlab # [ 132.726754] runuser[2198]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1330gitlab # [ 133.106831] setup-gitlab-start[2199]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1331gitlab # [ 133.111835] setup-gitlab-start[2199]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1332gitlab # [ 133.116583] setup-gitlab-start[2199]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1333gitlab # [ 133.668864] setup-gitlab-start[2199]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1334gitlab # [ 133.673865] setup-gitlab-start[2199]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1335gitlab # [ 133.678559] setup-gitlab-start[2199]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1336gitlab # [ 139.221949] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"de9fe45f0f60c9f01d69374d","created_at":"2026-10-02T14:12:14.458Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66d635058f3ea60b8f7a758df109b384","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.490Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-de9fe45f0f60c9f01d69374d: start","job_status":"start","queue_duration_s":0.002918,"scheduling_latency_s":0.002966}1337gitlab # [ 139.309866] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"de9fe45f0f60c9f01d69374d","created_at":"2026-10-02T14:12:14.458Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66d635058f3ea60b8f7a758df109b384","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.490Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-de9fe45f0f60c9f01d69374d: done: 0.088296 sec","job_status":"done","queue_duration_s":0.002918,"scheduling_latency_s":0.002966,"redis_calls":10,"redis_duration_s":0.005846,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000837,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003572,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000569067,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.088296,"completed_at":"2026-10-02T14:12:14.581Z","load_balancing_strategy":"primary","db_duration_s":0.016315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 139.366111] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"db72cb28614d619e18dc90df","created_at":"2026-10-02T14:12:14.523Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d88d87d6af35b96d79523f23afcc25a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.534Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-db72cb28614d619e18dc90df: start","job_status":"start","queue_duration_s":0.069671,"scheduling_latency_s":0.069701}1339gitlab # [ 139.378717] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"db72cb28614d619e18dc90df","created_at":"2026-10-02T14:12:14.523Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d88d87d6af35b96d79523f23afcc25a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.534Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-db72cb28614d619e18dc90df: done: 0.036473 sec","job_status":"done","queue_duration_s":0.069671,"scheduling_latency_s":0.069701,"redis_calls":12,"redis_duration_s":0.0037479999999999996,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002505,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000354794,"exclusive_lock_hold_duration_s":0.012507176,"duration_s":0.036473,"completed_at":"2026-10-02T14:12:14.640Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 139.415832] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f40b5daf1f7c7512b86faa49","created_at":"2026-10-02T14:12:14.545Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6e9eb2184df3558ba002bbfe62c9344","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-02T14:12:14.579Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f40b5daf1f7c7512b86faa49: start","job_status":"start","queue_duration_s":0.062364,"scheduling_latency_s":0.062378}1341gitlab # [ 139.427835] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.674Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1342gitlab # [ 139.431291] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f40b5daf1f7c7512b86faa49","created_at":"2026-10-02T14:12:14.545Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6e9eb2184df3558ba002bbfe62c9344","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-02T14:12:14.579Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f40b5daf1f7c7512b86faa49: done: 0.041822 sec","job_status":"done","queue_duration_s":0.062364,"scheduling_latency_s":0.062378,"redis_calls":10,"redis_duration_s":0.0048649999999999995,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400609,"duration_s":0.041822,"completed_at":"2026-10-02T14:12:14.683Z","load_balancing_strategy":"primary","db_duration_s":0.000767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 139.467685] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"86e6d9d236cb850885b234c2","created_at":"2026-10-02T14:12:14.607Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.618Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-86e6d9d236cb850885b234c2: start","job_status":"start","queue_duration_s":0.067837,"scheduling_latency_s":0.067863}1344gitlab # [ 139.468487] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"86e6d9d236cb850885b234c2","created_at":"2026-10-02T14:12:14.607Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.618Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-86e6d9d236cb850885b234c2: done: 0.050788 sec","job_status":"done","queue_duration_s":0.067837,"scheduling_latency_s":0.067863,"redis_calls":19,"redis_duration_s":0.011991,"redis_read_bytes":21,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001386,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001037,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006997,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000678578,"duration_s":0.050788,"completed_at":"2026-10-02T14:12:14.736Z","load_balancing_strategy":"primary","db_duration_s":0.005979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 139.513897] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e3e087c592889198633f7005","created_at":"2026-10-02T14:12:14.620Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcb379120a9721b561c1e263d9981e34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.625Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e3e087c592889198633f7005: start","job_status":"start","queue_duration_s":0.113455,"scheduling_latency_s":0.113469}1346gitlab # [ 139.514650] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.750Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1347gitlab # [ 139.515246] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e3e087c592889198633f7005","created_at":"2026-10-02T14:12:14.620Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcb379120a9721b561c1e263d9981e34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.625Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e3e087c592889198633f7005: done: 0.017543 sec","job_status":"done","queue_duration_s":0.113455,"scheduling_latency_s":0.113469,"redis_calls":10,"redis_duration_s":0.002046,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203937,"duration_s":0.017543,"completed_at":"2026-10-02T14:12:14.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 139.569047] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"27c3f679fb1e11769785e5e7","created_at":"2026-10-02T14:12:14.630Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8255548e1d76ea1611fbdb1e00e087ca","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.643Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-27c3f679fb1e11769785e5e7: start","job_status":"start","queue_duration_s":0.114978,"scheduling_latency_s":0.114992}1349gitlab # [ 139.603796] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"27c3f679fb1e11769785e5e7","created_at":"2026-10-02T14:12:14.630Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8255548e1d76ea1611fbdb1e00e087ca","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.643Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-27c3f679fb1e11769785e5e7: done: 0.118182 sec","job_status":"done","queue_duration_s":0.114978,"scheduling_latency_s":0.114992,"redis_calls":13,"redis_duration_s":0.006289,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003683,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002295,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.085,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008059683,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.118182,"completed_at":"2026-10-02T14:12:14.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08444,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1350gitlab # [ 139.648144] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"00dff6ea9b1b77581a66d301","created_at":"2026-10-02T14:12:14.654Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b31299994cf5a7295a700a4f115d31f9","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.672Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-00dff6ea9b1b77581a66d301: start","job_status":"start","queue_duration_s":0.248389,"scheduling_latency_s":0.248433}1351gitlab # [ 139.726865] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:14.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"00dff6ea9b1b77581a66d301","created_at":"2026-10-02T14:12:14.654Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b31299994cf5a7295a700a4f115d31f9","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.672Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-00dff6ea9b1b77581a66d301: done: 0.078807 sec","job_status":"done","queue_duration_s":0.248389,"scheduling_latency_s":0.248433,"redis_calls":10,"redis_duration_s":0.01032,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000836699,"duration_s":0.078807,"completed_at":"2026-10-02T14:12:14.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 139.758220] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"01c307b04d723315b3f1b96f","created_at":"2026-10-02T14:12:14.687Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b798508a1c54a42abde60a7a6bcc8c1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.695Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-01c307b04d723315b3f1b96f: start","job_status":"start","queue_duration_s":0.310598,"scheduling_latency_s":0.310626}1353gitlab # [ 139.759148] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.021Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1354gitlab # [ 139.759871] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"01c307b04d723315b3f1b96f","created_at":"2026-10-02T14:12:14.687Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b798508a1c54a42abde60a7a6bcc8c1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.695Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-01c307b04d723315b3f1b96f: done: 0.020283 sec","job_status":"done","queue_duration_s":0.310598,"scheduling_latency_s":0.310626,"redis_calls":10,"redis_duration_s":0.0027949999999999997,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000846,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000289143,"duration_s":0.020283,"completed_at":"2026-10-02T14:12:15.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 139.791810] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"953618ca036e4a80723bfbdb","created_at":"2026-10-02T14:12:14.705Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffe7be1a17ed378c3553d7b984f07873","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-02T14:12:14.713Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-953618ca036e4a80723bfbdb: start","job_status":"start","queue_duration_s":0.314346,"scheduling_latency_s":0.314358}1356gitlab # [ 139.803457] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"953618ca036e4a80723bfbdb","created_at":"2026-10-02T14:12:14.705Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffe7be1a17ed378c3553d7b984f07873","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-02T14:12:14.713Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-953618ca036e4a80723bfbdb: done: 0.020583 sec","job_status":"done","queue_duration_s":0.314346,"scheduling_latency_s":0.314358,"redis_calls":10,"redis_duration_s":0.001333,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231035,"duration_s":0.020583,"completed_at":"2026-10-02T14:12:15.048Z","load_balancing_strategy":"primary","db_duration_s":0.003077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 139.850725] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.049Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6b37cb71f3d4b7491b2345e9","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6b37cb71f3d4b7491b2345e9: start","job_status":"start","queue_duration_s":0.321572,"scheduling_latency_s":0.321584}1358gitlab # [ 139.856858] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.129Z","message":"No existing merge request to be cleaned up."}1359gitlab # [ 139.866939] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.139Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6b37cb71f3d4b7491b2345e9","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6b37cb71f3d4b7491b2345e9: done: 0.090323 sec","job_status":"done","queue_duration_s":0.321572,"scheduling_latency_s":0.321584,"redis_calls":13,"redis_duration_s":0.002567,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000740038,"duration_s":0.090323,"completed_at":"2026-10-02T14:12:15.139Z","load_balancing_strategy":"primary","db_duration_s":0.00271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 139.889094] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.140Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8cf3cd9b43e7af01d3314866","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8cf3cd9b43e7af01d3314866: start","job_status":"start","queue_duration_s":0.412931,"scheduling_latency_s":0.412948}1361gitlab # [ 139.900471] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.147Z","message":"No existing merge request to be cleaned up."}1362gitlab # [ 139.939082] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.152Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8cf3cd9b43e7af01d3314866","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8cf3cd9b43e7af01d3314866: done: 0.011254 sec","job_status":"done","queue_duration_s":0.412931,"scheduling_latency_s":0.412948,"redis_calls":10,"redis_duration_s":0.001232,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011254,"completed_at":"2026-10-02T14:12:15.151Z","load_balancing_strategy":"primary","db_duration_s":0.000871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 139.940572] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.152Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b48f5a5910e09cf70041e6df","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b48f5a5910e09cf70041e6df: start","job_status":"start","queue_duration_s":0.424974,"scheduling_latency_s":0.424987}1364gitlab # [ 139.947544] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.159Z","message":"No existing merge request to be cleaned up."}1365gitlab # [ 139.949061] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.163Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b48f5a5910e09cf70041e6df","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b48f5a5910e09cf70041e6df: done: 0.010881 sec","job_status":"done","queue_duration_s":0.424974,"scheduling_latency_s":0.424987,"redis_calls":10,"redis_duration_s":0.00124,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010881,"completed_at":"2026-10-02T14:12:15.163Z","load_balancing_strategy":"primary","db_duration_s":0.00089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 140.008380] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.164Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a5a5ff94e5752157c192015","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a5a5ff94e5752157c192015: start","job_status":"start","queue_duration_s":0.436792,"scheduling_latency_s":0.436805}1367gitlab # [ 140.009342] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.170Z","message":"No existing merge request to be cleaned up."}1368gitlab # [ 140.010261] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.175Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a5a5ff94e5752157c192015","created_at":"2026-10-02T14:12:14.708Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-a0e5670e18b445b5","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0f2724bd4bd6075d8984c8b7e2650133","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.727Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a5a5ff94e5752157c192015: done: 0.010512 sec","job_status":"done","queue_duration_s":0.436792,"scheduling_latency_s":0.436805,"redis_calls":10,"redis_duration_s":0.001266,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010512,"completed_at":"2026-10-02T14:12:15.175Z","load_balancing_strategy":"primary","db_duration_s":0.000881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 140.061242] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6200b0b98f9e22e65bd2d741","created_at":"2026-10-02T14:12:14.726Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1abafc86eb42104975cc0af2a6d5e6be","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.732Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6200b0b98f9e22e65bd2d741: start","job_status":"start","queue_duration_s":0.443151,"scheduling_latency_s":0.443164}1370gitlab # [ 140.061886] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6200b0b98f9e22e65bd2d741","created_at":"2026-10-02T14:12:14.726Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1abafc86eb42104975cc0af2a6d5e6be","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.732Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6200b0b98f9e22e65bd2d741: done: 0.013597 sec","job_status":"done","queue_duration_s":0.443151,"scheduling_latency_s":0.443164,"redis_calls":12,"redis_duration_s":0.001541,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000328254,"exclusive_lock_hold_duration_s":0.001900521,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013597,"completed_at":"2026-10-02T14:12:15.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 140.105119] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8f5c85e84a4848143043bbad","created_at":"2026-10-02T14:12:14.739Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b42bf927be278dd1127f091f349cce02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.756Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8f5c85e84a4848143043bbad: start","job_status":"start","queue_duration_s":0.434583,"scheduling_latency_s":0.434597}1372gitlab # [ 140.105825] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.197Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1373gitlab # [ 140.106544] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8f5c85e84a4848143043bbad","created_at":"2026-10-02T14:12:14.739Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b42bf927be278dd1127f091f349cce02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.756Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8f5c85e84a4848143043bbad: done: 0.011179 sec","job_status":"done","queue_duration_s":0.434583,"scheduling_latency_s":0.434597,"redis_calls":10,"redis_duration_s":0.00143,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000337753,"duration_s":0.011179,"completed_at":"2026-10-02T14:12:15.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 140.147044] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"77e94c5414bfd1929108ae26","created_at":"2026-10-02T14:12:14.765Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e82d74fecdddd898aa86d47ba49e360","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.775Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-77e94c5414bfd1929108ae26: start","job_status":"start","queue_duration_s":0.427809,"scheduling_latency_s":0.427822}1375gitlab # [ 140.148065] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.225Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"77e94c5414bfd1929108ae26","created_at":"2026-10-02T14:12:14.765Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e82d74fecdddd898aa86d47ba49e360","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.775Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-77e94c5414bfd1929108ae26: done: 0.02296 sec","job_status":"done","queue_duration_s":0.427809,"scheduling_latency_s":0.427822,"redis_calls":16,"redis_duration_s":0.002397,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001271,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.02296,"completed_at":"2026-10-02T14:12:15.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 140.201188] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"57b166933595a6a10ee7b7b6","created_at":"2026-10-02T14:12:14.862Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d73f461626bbf0da81b12ac1d9b15ded","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.874Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-57b166933595a6a10ee7b7b6: start","job_status":"start","queue_duration_s":0.352043,"scheduling_latency_s":0.352056}1377gitlab # [ 140.201889] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.233Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1378gitlab # [ 140.202541] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"57b166933595a6a10ee7b7b6","created_at":"2026-10-02T14:12:14.862Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d73f461626bbf0da81b12ac1d9b15ded","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.874Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-57b166933595a6a10ee7b7b6: done: 0.011132 sec","job_status":"done","queue_duration_s":0.352043,"scheduling_latency_s":0.352056,"redis_calls":10,"redis_duration_s":0.001202,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018913,"duration_s":0.011132,"completed_at":"2026-10-02T14:12:15.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 140.260296] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3f8031e50449ed5d6f07d653","created_at":"2026-10-02T14:12:14.917Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2412c6bde6e2fde9180959791e0d205","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.950Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3f8031e50449ed5d6f07d653: start","job_status":"start","queue_duration_s":0.288138,"scheduling_latency_s":0.288151}1380gitlab # [ 140.261209] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3f8031e50449ed5d6f07d653","created_at":"2026-10-02T14:12:14.917Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2412c6bde6e2fde9180959791e0d205","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.950Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3f8031e50449ed5d6f07d653: done: 0.230287 sec","job_status":"done","queue_duration_s":0.288138,"scheduling_latency_s":0.288151,"redis_calls":565,"redis_duration_s":0.070234,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.069136,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.17952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255898,"duration_s":0.230287,"completed_at":"2026-10-02T14:12:15.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 140.322361] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"aafc7b167627db981d3aef8c","created_at":"2026-10-02T14:12:14.967Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.982Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-aafc7b167627db981d3aef8c: start","job_status":"start","queue_duration_s":0.487872,"scheduling_latency_s":0.487886}1382gitlab # [ 140.323083] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"aafc7b167627db981d3aef8c","created_at":"2026-10-02T14:12:14.967Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:14.982Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-aafc7b167627db981d3aef8c: done: 0.067514 sec","job_status":"done","queue_duration_s":0.487872,"scheduling_latency_s":0.487886,"redis_calls":71,"redis_duration_s":0.009894,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001253,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000665,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007576,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390832,"duration_s":0.067514,"completed_at":"2026-10-02T14:12:15.537Z","load_balancing_strategy":"primary","db_duration_s":0.001239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 140.369290] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339144d72f5090f9cf476269","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339144d72f5090f9cf476269: start","job_status":"start","queue_duration_s":0.008238,"scheduling_latency_s":0.008252}1384gitlab # [ 140.370801] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339144d72f5090f9cf476269","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339144d72f5090f9cf476269: done: 0.014236 sec","job_status":"done","queue_duration_s":0.008238,"scheduling_latency_s":0.008252,"redis_calls":16,"redis_duration_s":0.001898,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000188572,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014236,"completed_at":"2026-10-02T14:12:15.553Z","load_balancing_strategy":"primary","db_duration_s":0.000328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 140.420817] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87e608f78d5b0e602e5112a0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87e608f78d5b0e602e5112a0: start","job_status":"start","queue_duration_s":0.023414,"scheduling_latency_s":0.023426}1386gitlab # [ 140.421674] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87e608f78d5b0e602e5112a0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87e608f78d5b0e602e5112a0: done: 0.009648 sec","job_status":"done","queue_duration_s":0.023414,"scheduling_latency_s":0.023426,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009648,"completed_at":"2026-10-02T14:12:15.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 140.429953] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60813bb6b503fc83811e5405","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60813bb6b503fc83811e5405: start","job_status":"start","queue_duration_s":0.034015,"scheduling_latency_s":0.034028}1388gitlab # [ 140.441227] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60813bb6b503fc83811e5405","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60813bb6b503fc83811e5405: done: 0.009091 sec","job_status":"done","queue_duration_s":0.034015,"scheduling_latency_s":0.034028,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009091,"completed_at":"2026-10-02T14:12:15.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 140.496337] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3925344feb47e17a1eae64d1","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3925344feb47e17a1eae64d1: start","job_status":"start","queue_duration_s":0.044019,"scheduling_latency_s":0.044032}1390gitlab # [ 140.497068] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3925344feb47e17a1eae64d1","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3925344feb47e17a1eae64d1: done: 0.009065 sec","job_status":"done","queue_duration_s":0.044019,"scheduling_latency_s":0.044032,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009065,"completed_at":"2026-10-02T14:12:15.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 140.539677] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c107a61d81ed38e0415a579e","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c107a61d81ed38e0415a579e: start","job_status":"start","queue_duration_s":0.054024,"scheduling_latency_s":0.054037}1392gitlab # [ 140.540554] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c107a61d81ed38e0415a579e","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c107a61d81ed38e0415a579e: done: 0.009268 sec","job_status":"done","queue_duration_s":0.054024,"scheduling_latency_s":0.054037,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009268,"completed_at":"2026-10-02T14:12:15.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 140.583625] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d36789c91933a7340d3cd35","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d36789c91933a7340d3cd35: start","job_status":"start","queue_duration_s":0.064254,"scheduling_latency_s":0.064267}1394gitlab # [ 140.584543] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d36789c91933a7340d3cd35","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d36789c91933a7340d3cd35: done: 0.009218 sec","job_status":"done","queue_duration_s":0.064254,"scheduling_latency_s":0.064267,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009218,"completed_at":"2026-10-02T14:12:15.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 140.639646] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9870b267fa8b00216f64c2e6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9870b267fa8b00216f64c2e6: start","job_status":"start","queue_duration_s":0.074339,"scheduling_latency_s":0.074352}1396gitlab # [ 140.640568] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9870b267fa8b00216f64c2e6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9870b267fa8b00216f64c2e6: done: 0.009389 sec","job_status":"done","queue_duration_s":0.074339,"scheduling_latency_s":0.074352,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009389,"completed_at":"2026-10-02T14:12:15.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 140.681329] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab33db8e680119e6a51af5a4","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab33db8e680119e6a51af5a4: start","job_status":"start","queue_duration_s":0.084492,"scheduling_latency_s":0.084505}1398gitlab # [ 140.682033] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab33db8e680119e6a51af5a4","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab33db8e680119e6a51af5a4: done: 0.01241 sec","job_status":"done","queue_duration_s":0.084492,"scheduling_latency_s":0.084505,"redis_calls":13,"redis_duration_s":0.001861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01241,"completed_at":"2026-10-02T14:12:15.627Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 140.706110] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c68811044d6bb0149b5e1be6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c68811044d6bb0149b5e1be6: start","job_status":"start","queue_duration_s":0.098014,"scheduling_latency_s":0.098027}1400gitlab # [ 140.744280] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c68811044d6bb0149b5e1be6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c68811044d6bb0149b5e1be6: done: 0.009676 sec","job_status":"done","queue_duration_s":0.098014,"scheduling_latency_s":0.098027,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009676,"completed_at":"2026-10-02T14:12:15.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 140.750555] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8168285cf292a7eeeae36cb9","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8168285cf292a7eeeae36cb9: start","job_status":"start","queue_duration_s":0.108439,"scheduling_latency_s":0.108451}1402gitlab # [ 140.796727] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8168285cf292a7eeeae36cb9","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8168285cf292a7eeeae36cb9: done: 0.017791 sec","job_status":"done","queue_duration_s":0.108439,"scheduling_latency_s":0.108451,"redis_calls":13,"redis_duration_s":0.009463,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005888,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003575,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017791,"completed_at":"2026-10-02T14:12:15.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 140.797911] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2254eb74f20c3ce08db21ac5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2254eb74f20c3ce08db21ac5: start","job_status":"start","queue_duration_s":0.127373,"scheduling_latency_s":0.127394}1404gitlab # [ 140.806599] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2254eb74f20c3ce08db21ac5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2254eb74f20c3ce08db21ac5: done: 0.011244 sec","job_status":"done","queue_duration_s":0.127373,"scheduling_latency_s":0.127394,"redis_calls":13,"redis_duration_s":0.00193,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011244,"completed_at":"2026-10-02T14:12:15.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 140.865059] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6afdc84f1ee4027dc3615908","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6afdc84f1ee4027dc3615908: start","job_status":"start","queue_duration_s":0.139533,"scheduling_latency_s":0.139546}1406gitlab # [ 140.865840] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6afdc84f1ee4027dc3615908","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6afdc84f1ee4027dc3615908: done: 0.008965 sec","job_status":"done","queue_duration_s":0.139533,"scheduling_latency_s":0.139546,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008965,"completed_at":"2026-10-02T14:12:15.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 140.903686] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a255e72376b52fb7bfc9dc5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a255e72376b52fb7bfc9dc5: start","job_status":"start","queue_duration_s":0.149361,"scheduling_latency_s":0.149373}1408gitlab # [ 140.904459] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a255e72376b52fb7bfc9dc5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a255e72376b52fb7bfc9dc5: done: 0.008703 sec","job_status":"done","queue_duration_s":0.149361,"scheduling_latency_s":0.149373,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008703,"completed_at":"2026-10-02T14:12:15.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 140.944692] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82dcb1484c0b94833335aa2a","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82dcb1484c0b94833335aa2a: start","job_status":"start","queue_duration_s":0.158921,"scheduling_latency_s":0.158934}1410gitlab # [ 140.945548] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82dcb1484c0b94833335aa2a","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82dcb1484c0b94833335aa2a: done: 0.008829 sec","job_status":"done","queue_duration_s":0.158921,"scheduling_latency_s":0.158934,"redis_calls":13,"redis_duration_s":0.0016780000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008829,"completed_at":"2026-10-02T14:12:15.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 140.984737] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880807906868779a61142bfd","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880807906868779a61142bfd: start","job_status":"start","queue_duration_s":0.168614,"scheduling_latency_s":0.168627}1412gitlab # [ 140.985993] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880807906868779a61142bfd","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880807906868779a61142bfd: done: 0.009124 sec","job_status":"done","queue_duration_s":0.168614,"scheduling_latency_s":0.168627,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009124,"completed_at":"2026-10-02T14:12:15.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 141.051825] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e189e8b7aafe2961c1948ee0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e189e8b7aafe2961c1948ee0: start","job_status":"start","queue_duration_s":0.178686,"scheduling_latency_s":0.178698}1414gitlab # [ 141.052728] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e189e8b7aafe2961c1948ee0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e189e8b7aafe2961c1948ee0: done: 0.009134 sec","job_status":"done","queue_duration_s":0.178686,"scheduling_latency_s":0.178698,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009134,"completed_at":"2026-10-02T14:12:15.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 141.093671] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8edd108f97713cecd6f15de7","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8edd108f97713cecd6f15de7: start","job_status":"start","queue_duration_s":0.188769,"scheduling_latency_s":0.188783}1416gitlab # [ 141.094620] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8edd108f97713cecd6f15de7","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8edd108f97713cecd6f15de7: done: 0.009645 sec","job_status":"done","queue_duration_s":0.188769,"scheduling_latency_s":0.188783,"redis_calls":13,"redis_duration_s":0.001505,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009645,"completed_at":"2026-10-02T14:12:15.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 141.133694] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cebe45cc0f4a523d7ede5e7f","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cebe45cc0f4a523d7ede5e7f: start","job_status":"start","queue_duration_s":0.199128,"scheduling_latency_s":0.199141}1418gitlab # [ 141.134604] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cebe45cc0f4a523d7ede5e7f","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cebe45cc0f4a523d7ede5e7f: done: 0.009538 sec","job_status":"done","queue_duration_s":0.199128,"scheduling_latency_s":0.199141,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009538,"completed_at":"2026-10-02T14:12:15.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 141.189258] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"866c6566b8f81ca61131bee3","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-866c6566b8f81ca61131bee3: start","job_status":"start","queue_duration_s":0.20962,"scheduling_latency_s":0.209633}1420gitlab # [ 141.189924] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"866c6566b8f81ca61131bee3","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-866c6566b8f81ca61131bee3: done: 0.00932 sec","job_status":"done","queue_duration_s":0.20962,"scheduling_latency_s":0.209633,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00932,"completed_at":"2026-10-02T14:12:15.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 141.200814] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf70173e6dc16d9095700c0e","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf70173e6dc16d9095700c0e: start","job_status":"start","queue_duration_s":0.219748,"scheduling_latency_s":0.219761}1422gitlab # [ 141.240493] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf70173e6dc16d9095700c0e","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf70173e6dc16d9095700c0e: done: 0.009223 sec","job_status":"done","queue_duration_s":0.219748,"scheduling_latency_s":0.219761,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009223,"completed_at":"2026-10-02T14:12:15.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 141.245648] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"946aa2fabf14b5d5d77b5698","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-946aa2fabf14b5d5d77b5698: start","job_status":"start","queue_duration_s":0.229829,"scheduling_latency_s":0.229841}1424gitlab # [ 141.285426] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"946aa2fabf14b5d5d77b5698","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-946aa2fabf14b5d5d77b5698: done: 0.009379 sec","job_status":"done","queue_duration_s":0.229829,"scheduling_latency_s":0.229841,"redis_calls":13,"redis_duration_s":0.001642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009379,"completed_at":"2026-10-02T14:12:15.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 141.289972] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aa40a63d9237819c8e6c2a5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aa40a63d9237819c8e6c2a5: start","job_status":"start","queue_duration_s":0.240243,"scheduling_latency_s":0.240256}1426gitlab # [ 141.301082] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aa40a63d9237819c8e6c2a5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aa40a63d9237819c8e6c2a5: done: 0.009151 sec","job_status":"done","queue_duration_s":0.240243,"scheduling_latency_s":0.240256,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009151,"completed_at":"2026-10-02T14:12:15.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 141.359567] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2390b2e5e42194e9a34df33e","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2390b2e5e42194e9a34df33e: start","job_status":"start","queue_duration_s":0.250342,"scheduling_latency_s":0.250355}1428gitlab # [ 141.360163] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2390b2e5e42194e9a34df33e","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2390b2e5e42194e9a34df33e: done: 0.009139 sec","job_status":"done","queue_duration_s":0.250342,"scheduling_latency_s":0.250355,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009139,"completed_at":"2026-10-02T14:12:15.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 141.414804] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"145630d8b61c27d69e08679f","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-145630d8b61c27d69e08679f: start","job_status":"start","queue_duration_s":0.260441,"scheduling_latency_s":0.260454}1430gitlab # [ 141.415722] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"145630d8b61c27d69e08679f","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-145630d8b61c27d69e08679f: done: 0.009187 sec","job_status":"done","queue_duration_s":0.260441,"scheduling_latency_s":0.260454,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009187,"completed_at":"2026-10-02T14:12:15.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 141.458168] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2230b3b022da70011b409418","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2230b3b022da70011b409418: start","job_status":"start","queue_duration_s":0.270607,"scheduling_latency_s":0.27062}1432gitlab # [ 141.458801] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2230b3b022da70011b409418","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2230b3b022da70011b409418: done: 0.009343 sec","job_status":"done","queue_duration_s":0.270607,"scheduling_latency_s":0.27062,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009343,"completed_at":"2026-10-02T14:12:15.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 141.506236] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3b8e987235f0fec40e90fd7","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3b8e987235f0fec40e90fd7: start","job_status":"start","queue_duration_s":0.281243,"scheduling_latency_s":0.281257}1434gitlab # [ 141.506925] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3b8e987235f0fec40e90fd7","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3b8e987235f0fec40e90fd7: done: 0.009551 sec","job_status":"done","queue_duration_s":0.281243,"scheduling_latency_s":0.281257,"redis_calls":13,"redis_duration_s":0.0014849999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009551,"completed_at":"2026-10-02T14:12:15.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 141.514908] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9935f310bf63fd997d0242ce","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9935f310bf63fd997d0242ce: start","job_status":"start","queue_duration_s":0.291771,"scheduling_latency_s":0.291785}1436gitlab # [ 141.527546] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9935f310bf63fd997d0242ce","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9935f310bf63fd997d0242ce: done: 0.011255 sec","job_status":"done","queue_duration_s":0.291771,"scheduling_latency_s":0.291785,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011255,"completed_at":"2026-10-02T14:12:15.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 141.577736] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3eb915c8377e5790fedb90b","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3eb915c8377e5790fedb90b: start","job_status":"start","queue_duration_s":0.303959,"scheduling_latency_s":0.303973}1438gitlab # [ 141.578490] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3eb915c8377e5790fedb90b","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3eb915c8377e5790fedb90b: done: 0.00921 sec","job_status":"done","queue_duration_s":0.303959,"scheduling_latency_s":0.303973,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00921,"completed_at":"2026-10-02T14:12:15.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 141.618142] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd9c2e7ffa73259f079e1b37","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd9c2e7ffa73259f079e1b37: start","job_status":"start","queue_duration_s":0.313971,"scheduling_latency_s":0.313983}1440gitlab # [ 141.618861] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd9c2e7ffa73259f079e1b37","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd9c2e7ffa73259f079e1b37: done: 0.009206 sec","job_status":"done","queue_duration_s":0.313971,"scheduling_latency_s":0.313983,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009206,"completed_at":"2026-10-02T14:12:15.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 141.663130] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1cb69bbe0e456cf57e333b5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1cb69bbe0e456cf57e333b5: start","job_status":"start","queue_duration_s":0.323974,"scheduling_latency_s":0.323987}1442gitlab # [ 141.663740] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1cb69bbe0e456cf57e333b5","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1cb69bbe0e456cf57e333b5: done: 0.010625 sec","job_status":"done","queue_duration_s":0.323974,"scheduling_latency_s":0.323987,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010625,"completed_at":"2026-10-02T14:12:15.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 141.707741] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08a3862ec080ab0591f48992","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08a3862ec080ab0591f48992: start","job_status":"start","queue_duration_s":0.3355,"scheduling_latency_s":0.335513}1444gitlab # [ 141.708550] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08a3862ec080ab0591f48992","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08a3862ec080ab0591f48992: done: 0.009456 sec","job_status":"done","queue_duration_s":0.3355,"scheduling_latency_s":0.335513,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009456,"completed_at":"2026-10-02T14:12:15.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 141.748100] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca11aa808611890fd4e00465","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca11aa808611890fd4e00465: start","job_status":"start","queue_duration_s":0.345885,"scheduling_latency_s":0.345898}1446gitlab # [ 141.751057] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca11aa808611890fd4e00465","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca11aa808611890fd4e00465: done: 0.010243 sec","job_status":"done","queue_duration_s":0.345885,"scheduling_latency_s":0.345898,"redis_calls":13,"redis_duration_s":0.0017430000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010243,"completed_at":"2026-10-02T14:12:15.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 141.796653] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63af6dc8fea48a6afee9538b","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63af6dc8fea48a6afee9538b: start","job_status":"start","queue_duration_s":0.357021,"scheduling_latency_s":0.357036}1448gitlab # [ 141.797550] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63af6dc8fea48a6afee9538b","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63af6dc8fea48a6afee9538b: done: 0.00937 sec","job_status":"done","queue_duration_s":0.357021,"scheduling_latency_s":0.357036,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00937,"completed_at":"2026-10-02T14:12:15.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 141.849647] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"135f4bb97f4004147d595b8a","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-135f4bb97f4004147d595b8a: start","job_status":"start","queue_duration_s":0.36733,"scheduling_latency_s":0.367343}1450gitlab # [ 141.850281] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"135f4bb97f4004147d595b8a","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-135f4bb97f4004147d595b8a: done: 0.010499 sec","job_status":"done","queue_duration_s":0.36733,"scheduling_latency_s":0.367343,"redis_calls":13,"redis_duration_s":0.002127,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010499,"completed_at":"2026-10-02T14:12:15.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 141.889806] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06cb2ba22d83799380475535","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06cb2ba22d83799380475535: start","job_status":"start","queue_duration_s":0.378877,"scheduling_latency_s":0.378892}1452gitlab # [ 141.890715] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06cb2ba22d83799380475535","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06cb2ba22d83799380475535: done: 0.009655 sec","job_status":"done","queue_duration_s":0.378877,"scheduling_latency_s":0.378892,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009655,"completed_at":"2026-10-02T14:12:15.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 141.934299] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e243a1bc041dbdeb94cedb32","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e243a1bc041dbdeb94cedb32: start","job_status":"start","queue_duration_s":0.389906,"scheduling_latency_s":0.389919}1454gitlab # [ 141.934894] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e243a1bc041dbdeb94cedb32","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e243a1bc041dbdeb94cedb32: done: 0.009412 sec","job_status":"done","queue_duration_s":0.389906,"scheduling_latency_s":0.389919,"redis_calls":13,"redis_duration_s":0.001517,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009412,"completed_at":"2026-10-02T14:12:15.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 142.000603] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e090f2b22672c36be0c0aaae","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e090f2b22672c36be0c0aaae: start","job_status":"start","queue_duration_s":0.400263,"scheduling_latency_s":0.400275}1456gitlab # [ 142.001523] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e090f2b22672c36be0c0aaae","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e090f2b22672c36be0c0aaae: done: 0.009979 sec","job_status":"done","queue_duration_s":0.400263,"scheduling_latency_s":0.400275,"redis_calls":13,"redis_duration_s":0.001712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009979,"completed_at":"2026-10-02T14:12:15.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 142.042591] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"341ac56741fec4d1e774be26","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-341ac56741fec4d1e774be26: start","job_status":"start","queue_duration_s":0.411212,"scheduling_latency_s":0.411225}1458gitlab # [ 142.043545] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"341ac56741fec4d1e774be26","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-341ac56741fec4d1e774be26: done: 0.009276 sec","job_status":"done","queue_duration_s":0.411212,"scheduling_latency_s":0.411225,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009276,"completed_at":"2026-10-02T14:12:15.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 142.054708] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"853639df56968c930d70afc6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-853639df56968c930d70afc6: start","job_status":"start","queue_duration_s":0.421484,"scheduling_latency_s":0.421497}1460gitlab # [ 142.092722] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"853639df56968c930d70afc6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-853639df56968c930d70afc6: done: 0.009177 sec","job_status":"done","queue_duration_s":0.421484,"scheduling_latency_s":0.421497,"redis_calls":13,"redis_duration_s":0.001685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009177,"completed_at":"2026-10-02T14:12:15.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 142.131534] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a76829289f4958404079019","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a76829289f4958404079019: start","job_status":"start","queue_duration_s":0.431451,"scheduling_latency_s":0.431463}1462gitlab # [ 142.132298] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a76829289f4958404079019","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a76829289f4958404079019: done: 0.009281 sec","job_status":"done","queue_duration_s":0.431451,"scheduling_latency_s":0.431463,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009281,"completed_at":"2026-10-02T14:12:15.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 142.171285] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29e4a99bc806266ac21c12b2","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29e4a99bc806266ac21c12b2: start","job_status":"start","queue_duration_s":0.441504,"scheduling_latency_s":0.441517}1464gitlab # [ 142.171837] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29e4a99bc806266ac21c12b2","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29e4a99bc806266ac21c12b2: done: 0.009477 sec","job_status":"done","queue_duration_s":0.441504,"scheduling_latency_s":0.441517,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009477,"completed_at":"2026-10-02T14:12:15.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 142.188662] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be1d23bdfcaed0c6d118b0c6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be1d23bdfcaed0c6d118b0c6: start","job_status":"start","queue_duration_s":0.451881,"scheduling_latency_s":0.451894}1466gitlab # [ 142.199736] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be1d23bdfcaed0c6d118b0c6","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be1d23bdfcaed0c6d118b0c6: done: 0.009323 sec","job_status":"done","queue_duration_s":0.451881,"scheduling_latency_s":0.451894,"redis_calls":13,"redis_duration_s":0.0018470000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009323,"completed_at":"2026-10-02T14:12:15.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 142.239079] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:15.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e58ad87308d66fc131b682b3","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e58ad87308d66fc131b682b3: start","job_status":"start","queue_duration_s":0.46206,"scheduling_latency_s":0.462073}1468gitlab # [ 142.278047] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e58ad87308d66fc131b682b3","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e58ad87308d66fc131b682b3: done: 0.009489 sec","job_status":"done","queue_duration_s":0.46206,"scheduling_latency_s":0.462073,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009489,"completed_at":"2026-10-02T14:12:16.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 142.279459] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74dc7ebfe40cd2c7e982e492","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74dc7ebfe40cd2c7e982e492: start","job_status":"start","queue_duration_s":0.472375,"scheduling_latency_s":0.472388}1470gitlab # [ 142.290818] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74dc7ebfe40cd2c7e982e492","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74dc7ebfe40cd2c7e982e492: done: 0.052604 sec","job_status":"done","queue_duration_s":0.472375,"scheduling_latency_s":0.472388,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052604,"completed_at":"2026-10-02T14:12:16.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 142.332053] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ede804443cf2dffa17e407d0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ede804443cf2dffa17e407d0: start","job_status":"start","queue_duration_s":0.52642,"scheduling_latency_s":0.526448}1472gitlab # [ 142.335682] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ede804443cf2dffa17e407d0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ede804443cf2dffa17e407d0: done: 0.011814 sec","job_status":"done","queue_duration_s":0.52642,"scheduling_latency_s":0.526448,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011814,"completed_at":"2026-10-02T14:12:16.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 142.383566] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aa7d5140b8c3e7dae3b9756","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aa7d5140b8c3e7dae3b9756: start","job_status":"start","queue_duration_s":0.539155,"scheduling_latency_s":0.539172}1474gitlab # [ 142.384449] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aa7d5140b8c3e7dae3b9756","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aa7d5140b8c3e7dae3b9756: done: 0.009895 sec","job_status":"done","queue_duration_s":0.539155,"scheduling_latency_s":0.539172,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009895,"completed_at":"2026-10-02T14:12:16.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 142.424719] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024a64deeed1e4f8a7dcc5f0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024a64deeed1e4f8a7dcc5f0: start","job_status":"start","queue_duration_s":0.549924,"scheduling_latency_s":0.549937}1476gitlab # [ 142.426778] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024a64deeed1e4f8a7dcc5f0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024a64deeed1e4f8a7dcc5f0: done: 0.008868 sec","job_status":"done","queue_duration_s":0.549924,"scheduling_latency_s":0.549937,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008868,"completed_at":"2026-10-02T14:12:16.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 142.492217] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd9d52d5bc801267eac42d0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd9d52d5bc801267eac42d0: start","job_status":"start","queue_duration_s":0.559614,"scheduling_latency_s":0.559627}1478gitlab # [ 142.492814] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd9d52d5bc801267eac42d0","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd9d52d5bc801267eac42d0: done: 0.008702 sec","job_status":"done","queue_duration_s":0.559614,"scheduling_latency_s":0.559627,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008702,"completed_at":"2026-10-02T14:12:16.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 142.531958] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b59d12bfc5fe6bc545e3a356","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b59d12bfc5fe6bc545e3a356: start","job_status":"start","queue_duration_s":0.569075,"scheduling_latency_s":0.569087}1480gitlab # [ 142.532768] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b59d12bfc5fe6bc545e3a356","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b59d12bfc5fe6bc545e3a356: done: 0.008966 sec","job_status":"done","queue_duration_s":0.569075,"scheduling_latency_s":0.569087,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008966,"completed_at":"2026-10-02T14:12:16.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 142.572163] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24219e6a1155423b090c29a8","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24219e6a1155423b090c29a8: start","job_status":"start","queue_duration_s":0.578876,"scheduling_latency_s":0.578888}1482gitlab # [ 142.572855] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:16.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24219e6a1155423b090c29a8","created_at":"2026-10-02T14:12:15.484Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-5843f73a2d47425e","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fec3163c605ae7a6ef949644051b5a54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:12:15.530Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24219e6a1155423b090c29a8: done: 0.008997 sec","job_status":"done","queue_duration_s":0.578876,"scheduling_latency_s":0.578888,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008997,"completed_at":"2026-10-02T14:12:16.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 142.785011] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2390946152 wd_nsec: 23909461451484gitlab # [ 142.646208] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:17.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a6cab16784a5f549b3aa6a12","created_at":"2026-10-02T14:12:14.997Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c13ea52217f4090c781b5ebfc678fc5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:17.913Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a6cab16784a5f549b3aa6a12: start","job_status":"start","queue_duration_s":0.003792,"scheduling_latency_s":0.003819}1485gitlab # [ 142.698726] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:17.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a6cab16784a5f549b3aa6a12","created_at":"2026-10-02T14:12:14.997Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c13ea52217f4090c781b5ebfc678fc5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:17.913Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a6cab16784a5f549b3aa6a12: done: 0.054801 sec","job_status":"done","queue_duration_s":0.003792,"scheduling_latency_s":0.003819,"redis_calls":10,"redis_duration_s":0.017591,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000478552,"duration_s":0.054801,"completed_at":"2026-10-02T14:12:17.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 142.745800] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.018Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"616bdff7bbfda11d91aff0e8","created_at":"2026-10-02T14:12:17.936Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"af4137a0ccb2f5b387e5ef4417ff51b4","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.013Z","job_size_bytes":3,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-616bdff7bbfda11d91aff0e8: start","job_status":"start","queue_duration_s":0.00537,"scheduling_latency_s":0.005388}1487gitlab # [ 142.892239] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.164Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"616bdff7bbfda11d91aff0e8","created_at":"2026-10-02T14:12:17.936Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"af4137a0ccb2f5b387e5ef4417ff51b4","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.013Z","job_size_bytes":3,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-616bdff7bbfda11d91aff0e8: done: 0.146237 sec","job_status":"done","queue_duration_s":0.00537,"scheduling_latency_s":0.005388,"redis_calls":10,"redis_duration_s":0.009076,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000608457,"duration_s":0.146237,"completed_at":"2026-10-02T14:12:18.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 142.969371] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"77087a3c663ed4aefc1a720f","created_at":"2026-10-02T14:12:18.017Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df16d0c20d85f2ccbde096937b603085","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.052Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-77087a3c663ed4aefc1a720f: start","job_status":"start","queue_duration_s":0.189512,"scheduling_latency_s":0.189554}1489gitlab # [ 143.173967] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"77087a3c663ed4aefc1a720f","created_at":"2026-10-02T14:12:18.017Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df16d0c20d85f2ccbde096937b603085","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.052Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-77087a3c663ed4aefc1a720f: done: 0.204868 sec","job_status":"done","queue_duration_s":0.189512,"scheduling_latency_s":0.189554,"redis_calls":14,"redis_duration_s":0.03579,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.021371,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001802464,"exclusive_lock_hold_duration_s":0.10558409,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.204868,"completed_at":"2026-10-02T14:12:18.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.120767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 143.249291] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"15fe530ffdb02abbccce3a98","created_at":"2026-10-02T14:12:18.058Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d45b904dced11cc94d78b1e8d87e491e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.065Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-15fe530ffdb02abbccce3a98: start","job_status":"start","queue_duration_s":0.456665,"scheduling_latency_s":0.45671}1491gitlab # [ 143.317230] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"15fe530ffdb02abbccce3a98","created_at":"2026-10-02T14:12:18.058Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d45b904dced11cc94d78b1e8d87e491e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.065Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-15fe530ffdb02abbccce3a98: done: 0.066843 sec","job_status":"done","queue_duration_s":0.456665,"scheduling_latency_s":0.45671,"redis_calls":12,"redis_duration_s":0.016422,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005757,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000967721,"duration_s":0.066843,"completed_at":"2026-10-02T14:12:18.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 143.373924] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"094cca0c8eaceacb637d061f","created_at":"2026-10-02T14:12:18.072Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24fe33cdedc88c61d98f003e8ac13eb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.082Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-094cca0c8eaceacb637d061f: start","job_status":"start","queue_duration_s":0.563705,"scheduling_latency_s":0.563747}1493gitlab # [ 143.472912] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"094cca0c8eaceacb637d061f","created_at":"2026-10-02T14:12:18.072Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24fe33cdedc88c61d98f003e8ac13eb1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.082Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-094cca0c8eaceacb637d061f: done: 0.098872 sec","job_status":"done","queue_duration_s":0.563705,"scheduling_latency_s":0.563747,"redis_calls":12,"redis_duration_s":0.028367000000000003,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002137,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01921,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001468622,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.098872,"completed_at":"2026-10-02T14:12:18.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 143.517460] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"67492e2e321b68a3c889d4a4","created_at":"2026-10-02T14:12:18.087Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"262d7979008503bb4d1db1207a4cf61c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.096Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-67492e2e321b68a3c889d4a4: start","job_status":"start","queue_duration_s":0.65468,"scheduling_latency_s":0.654718}1495gitlab # [ 143.532721] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.805Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"67492e2e321b68a3c889d4a4","created_at":"2026-10-02T14:12:18.087Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"262d7979008503bb4d1db1207a4cf61c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.096Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-67492e2e321b68a3c889d4a4: done: 0.054214 sec","job_status":"done","queue_duration_s":0.65468,"scheduling_latency_s":0.654718,"redis_calls":12,"redis_duration_s":0.023790000000000002,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.005669,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004851,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002162006,"duration_s":0.054214,"completed_at":"2026-10-02T14:12:18.805Z","load_balancing_strategy":"primary","db_duration_s":0.000579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 143.553811] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e5b0c61a6ce278121e8e94bb","created_at":"2026-10-02T14:12:18.112Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4a76ebc60d954d4152fb70926fdfcb4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.137Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e5b0c61a6ce278121e8e94bb: start","job_status":"start","queue_duration_s":0.674092,"scheduling_latency_s":0.674119}1497gitlab # [ 143.670637] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:18.942Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e5b0c61a6ce278121e8e94bb","created_at":"2026-10-02T14:12:18.112Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4a76ebc60d954d4152fb70926fdfcb4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.137Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e5b0c61a6ce278121e8e94bb: done: 0.131759 sec","job_status":"done","queue_duration_s":0.674092,"scheduling_latency_s":0.674119,"redis_calls":12,"redis_duration_s":0.047717999999999997,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.038527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005895,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00205529,"exclusive_lock_hold_duration_s":0.034782913,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.131759,"completed_at":"2026-10-02T14:12:18.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034048,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 143.729244] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"95f9f90ef8350bc2a1bd222f","created_at":"2026-10-02T14:12:18.167Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fd386f9e5a02b5b6893c07445a7ec7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-02T14:12:18.259Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-95f9f90ef8350bc2a1bd222f: start","job_status":"start","queue_duration_s":0.742611,"scheduling_latency_s":0.742636}1499gitlab # [ 143.764344] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.037Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1500gitlab # [ 143.778588] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"95f9f90ef8350bc2a1bd222f","created_at":"2026-10-02T14:12:18.167Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fd386f9e5a02b5b6893c07445a7ec7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-02T14:12:18.259Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-95f9f90ef8350bc2a1bd222f: done: 0.049511 sec","job_status":"done","queue_duration_s":0.742611,"scheduling_latency_s":0.742636,"redis_calls":10,"redis_duration_s":0.007535,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001894,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004446,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002021207,"duration_s":0.049511,"completed_at":"2026-10-02T14:12:19.051Z","load_balancing_strategy":"primary","db_duration_s":0.001725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 143.819437] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d54c8f6b5b1874062617598d","created_at":"2026-10-02T14:12:18.294Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5aa2c6c8e742713431f17e436f49bdc7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.316Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d54c8f6b5b1874062617598d: start","job_status":"start","queue_duration_s":0.776254,"scheduling_latency_s":0.776277}1502gitlab # [ 143.875614] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.148Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d54c8f6b5b1874062617598d","created_at":"2026-10-02T14:12:18.294Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5aa2c6c8e742713431f17e436f49bdc7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.316Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d54c8f6b5b1874062617598d: done: 0.056073 sec","job_status":"done","queue_duration_s":0.776254,"scheduling_latency_s":0.776277,"redis_calls":10,"redis_duration_s":0.012414000000000001,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002161,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000839772,"duration_s":0.056073,"completed_at":"2026-10-02T14:12:19.148Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 143.919103] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8b7a96d38a9972ec8bee4528","created_at":"2026-10-02T14:12:18.330Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3dd0f227a6774477ec80cd32cef887c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.364Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8b7a96d38a9972ec8bee4528: start","job_status":"start","queue_duration_s":0.827151,"scheduling_latency_s":0.827175}1504gitlab # [ 143.997788] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8b7a96d38a9972ec8bee4528","created_at":"2026-10-02T14:12:18.330Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3dd0f227a6774477ec80cd32cef887c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.364Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8b7a96d38a9972ec8bee4528: done: 0.078256 sec","job_status":"done","queue_duration_s":0.827151,"scheduling_latency_s":0.827175,"redis_calls":12,"redis_duration_s":0.014903,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002957,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006537,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005409,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001187301,"exclusive_lock_hold_duration_s":0.014991291,"duration_s":0.078256,"completed_at":"2026-10-02T14:12:19.270Z","load_balancing_strategy":"primary","db_duration_s":0.009967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 144.041171] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b39af3d2ae9eaf8e984c3530","created_at":"2026-10-02T14:12:18.377Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edc720f379667bf59b7de60a62f53196","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.390Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b39af3d2ae9eaf8e984c3530: start","job_status":"start","queue_duration_s":0.923093,"scheduling_latency_s":0.923133}1506gitlab # [ 144.457495] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:19.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b39af3d2ae9eaf8e984c3530","created_at":"2026-10-02T14:12:18.377Z","trace_propagation_headers":{"sentry-trace":"aa5a7664a8e048dca0571167cd11b03d-486db6db8abe4db4","baggage":"sentry-trace_id=aa5a7664a8e048dca0571167cd11b03d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edc720f379667bf59b7de60a62f53196","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-02T14:12:18.390Z","job_size_bytes":2,"pid":1603,"sidekiq_tid":"madz","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b39af3d2ae9eaf8e984c3530: done: 0.416661 sec","job_status":"done","queue_duration_s":0.923093,"scheduling_latency_s":0.923133,"redis_calls":14,"redis_duration_s":0.01598,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006472,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00367,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001177524,"exclusive_lock_hold_duration_s":0.34651079900000004,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.416661,"completed_at":"2026-10-02T14:12:19.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.188805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 157.795113] setup-gitlab-start[2199]: W, [2026-10-02T14:12:33.067591 #2199] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1508gitlab # [ 178.796882] postgres[2398]: [2398] ERROR: relation "table_without_models" does not exist1509gitlab # [ 178.799934] postgres[2398]: [2398] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1510gitlab # [ 182.162514] runuser[2198]: pam_unix(runuser:session): session closed for user gitlab1511gitlab # [ 182.165922] setup-gitlab-start[2180]: + systemctl restart gitlab-sidekiq.service1512gitlab # [ 182.195442] systemd[1]: Stopping gitlab-sidekiq.service...1513gitlab # [ 182.197932] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:57.468Z","message":"Shutting down"}1514gitlab # [ 182.199430] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:57.468Z","message":"Scheduler exiting..."}1515gitlab # [ 182.204098] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:57.471Z","message":"Terminating quiet threads for default capsule"}1516gitlab # [ 182.205538] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:57.477Z","message":"Scheduler exiting..."}1517gitlab # [ 182.712226] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:12:57.984Z","message":"Pausing to allow jobs to finish..."}1518gitlab # [ 185.216610] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:13:00.488Z","message":"Bye!"}1519gitlab # [ 185.241886] sidekiq-cluster[1603]: {"severity":"INFO","time":"2026-10-02T14:13:00.514Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1603,"worker_id":"sidekiq_0","memwd_rss_bytes":934744064,"retry":0}1520gitlab # [ 186.078648] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1521gitlab # [ 186.081336] systemd[1]: Stopped gitlab-sidekiq.service.1522gitlab # [ 186.083127] systemd[1]: gitlab-sidekiq.service: Consumed 54.237s CPU time over 1min 53.965s wall clock time, 957.7M memory peak, 5.2M read from disk.1523gitlab # [ 186.092419] systemd[1]: Started gitlab-sidekiq.service.1524gitlab # [ 186.096794] setup-gitlab-start[2180]: + mkdir -p /var/lib/secrets1525gitlab # [ 186.102395] setup-gitlab-start[2180]: + echo nixbot-test-token-of-20-chars1526gitlab # [ 186.104730] setup-gitlab-start[2180]: + chmod 644 /var/lib/secrets/gitlab-token1527gitlab # [ 186.107281] setup-gitlab-start[2180]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1528gitlab # [ 186.324654] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:01 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1921529gitlab # [ 186.797498] gitaly[894]: time="2026-10-02T14:13:02.070Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.069" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1530gitlab # [ 186.799599] gitaly[894]: time="2026-10-02T14:13:02.070Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.069" grpc.time_ms=0.406 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 186.884640] gitaly[894]: time="2026-10-02T14:13:02.157Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.157" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 186.907799] gitaly[894]: time="2026-10-02T14:13:02.157Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.157" grpc.time_ms=0.364 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 186.960902] gitaly[894]: time="2026-10-02T14:13:02.233Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 diskcache=0048566d-ccb4-403d-a0f6-65c435fce121 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T14:13:12.124" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.185" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 186.962670] gitaly[894]: time="2026-10-02T14:13:02.234Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T14:13:12.124" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.185" grpc.time_ms=48.54 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 186.970720] gitaly[894]: time="2026-10-02T14:13:02.243Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.182" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.243" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1536gitlab # [ 186.973858] gitaly[894]: time="2026-10-02T14:13:02.244Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.182" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.243" grpc.time_ms=0.755 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1537gitlab # [ 186.984201] gitaly[894]: time="2026-10-02T14:13:02.256Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:13:12.189" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.249" grpc.time_ms=7.084 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 187.025692] gitaly[894]: time="2026-10-02T14:13:02.298Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.238" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.298" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 187.027247] gitaly[894]: time="2026-10-02T14:13:02.299Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.238" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.298" grpc.time_ms=0.336 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 187.070533] gitaly[894]: time="2026-10-02T14:13:02.343Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 diskcache=67d9569f-7347-4d88-b556-568000a740ea grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T14:13:12.241" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.301" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 187.071145] gitaly[894]: time="2026-10-02T14:13:02.343Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T14:13:12.241" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.301" grpc.time_ms=42.34 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1542gitlab # [ 187.076871] gitaly[894]: time="2026-10-02T14:13:02.349Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.288" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.349" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1543gitlab # [ 187.077726] gitaly[894]: time="2026-10-02T14:13:02.350Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.288" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.349" grpc.time_ms=0.643 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1544gitlab # [ 187.085991] gitaly[894]: time="2026-10-02T14:13:02.359Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:13:12.293" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.353" grpc.time_ms=5.033 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 187.108897] gitaly[894]: time="2026-10-02T14:13:02.381Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:13:12.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.381" grpc.time_ms=0.184 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 187.113956] gitaly[894]: time="2026-10-02T14:13:02.387Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T14:13:12.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.386" grpc.time_ms=0.289 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 187.591306] gitaly[894]: time="2026-10-02T14:13:02.864Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFC61ASGW62E1SCYWN7BC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:13:12.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:02.857" grpc.time_ms=6.371 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 187.852455] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:03 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 15141549gitlab # [ 187.853624] setup-gitlab-start[2452]: {"id":1,"message":null,"error":null}1550gitlab # [ 189.131841] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-10-02T14:13:04.387Z","message":"Starting cluster with 1 processes"}1551gitlab # [ 193.367580] gitaly[894]: time="2026-10-02T14:13:08.639Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCCDV6Q3J83GY01V4YJ0P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:13:18.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:08.628" grpc.time_ms=10.596 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1552gitlab # [ 193.931909] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:09 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 10481553gitlab # [ 193.935067] setup-gitlab-start[2180]: + mkdir -p /tmp/test-flake1554gitlab # [ 193.941411] setup-gitlab-start[2180]: + cd /tmp/test-flake1555gitlab # [ 193.943136] setup-gitlab-start[2180]: + git init -b master1556gitlab # [ 193.970333] setup-gitlab-start[2539]: Initialized empty Git repository in /tmp/test-flake/.git/1557gitlab # [ 193.972275] setup-gitlab-start[2180]: + git config user.name test1558gitlab # [ 193.978897] setup-gitlab-start[2180]: + git config user.email test@example.com1559gitlab # [ 193.986068] setup-gitlab-start[2180]: + cat1560gitlab # [ 193.990847] setup-gitlab-start[2180]: + git add flake.nix1561gitlab # [ 193.997944] setup-gitlab-start[2180]: + git commit -m 'initial commit'1562gitlab # [ 194.026915] setup-gitlab-start[2544]: [master (root-commit) 6c5a08f] initial commit1563gitlab # [ 194.028508] setup-gitlab-start[2544]: 1 file changed, 10 insertions(+)1564gitlab # [ 194.029949] setup-gitlab-start[2544]: create mode 100644 flake.nix1565gitlab # [ 194.033932] setup-gitlab-start[2180]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1566gitlab # [ 194.044689] setup-gitlab-start[2180]: + git push -u origin master1567gitlab # [ 194.116289] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 411568gitlab # [ 194.208555] gitaly[894]: time="2026-10-02T14:13:09.481Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDMKSWNJSZH7R4A1P0Z9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:09.474" grpc.time_ms=7.206 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1569gitlab # [ 194.210210] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 861570gitlab # [ 194.449858] gitaly[894]: time="2026-10-02T14:13:09.722Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:13:19.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:09.708" grpc.time_ms=13.908 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1571gitlab # [ 194.489490] gitaly[894]: time="2026-10-02T14:13:09.762Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-02T14:13:39.053" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-02T14:13:09.753" grpc.time_ms=8.826 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1572gitlab # [ 194.537147] gitaly[894]: time="2026-10-02T14:13:09.810Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 duration_ms=159ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1573gitlab # [ 194.582798] gitaly[894]: time="2026-10-02T14:13:09.855Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 duration_ms=44ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1574gitlab # [ 194.583586] gitaly[894]: time="2026-10-02T14:13:09.856Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:09.649" grpc.time_ms=206.922 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1575gitlab # [ 194.649328] gitaly[894]: time="2026-10-02T14:13:09.922Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:09.921" grpc.time_ms=0.698 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1576gitlab # [ 194.708957] gitaly[894]: time="2026-10-02T14:13:09.981Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:09.981" grpc.time_ms=0.53 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1577gitlab # [ 194.752396] gitaly[894]: time="2026-10-02T14:13:10.025Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:10.024" grpc.time_ms=0.517 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1578gitlab # [ 194.873502] gitaly[894]: time="2026-10-02T14:13:10.146Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:13:20.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:10.140" grpc.time_ms=5.414 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 194.930079] gitaly[894]: time="2026-10-02T14:13:10.203Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1564 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-02T14:13:20.048" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:10.179" grpc.time_ms=23.216 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 194.970372] gitaly[894]: time="2026-10-02T14:13:10.243Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 duration_ms=187ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1581gitlab # [ 194.976243] gitaly[894]: time="2026-10-02T14:13:10.249Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:10.054" grpc.time_ms=194.651 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1582gitlab # [ 195.002689] gitaly[894]: time="2026-10-02T14:13:10.275Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 diskcache=017db437-3a72-4144-b812-bb4826b6951a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:09.576" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1583gitlab # [ 195.003822] gitaly[894]: time="2026-10-02T14:13:10.275Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=238 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13816 command.oublock=32 command.real_time_ms=689 command.spawn_token_fork_ms=1 command.system_time_ms=152 command.user_time_ms=86 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:09.576" grpc.time_ms=699.281 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1584gitlab # [ 195.024445] gitlab-workhorse[821]: time="2026-10-02T14:13:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521585gitlab # [ 195.025576] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:10 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7711586gitlab # [ 195.028849] setup-gitlab-start[2548]: To http://gitlab/root/test-flake.git1587gitlab # [ 195.029816] setup-gitlab-start[2548]: * [new branch] master -> master1588gitlab # [ 195.034508] setup-gitlab-start[2548]: branch 'master' set up to track 'origin/master'.1589gitlab # [ 195.038103] systemd[1]: Finished setup-gitlab.service.1590gitlab # [ 195.043806] systemd[1]: Starting nixbot CI service...1591gitlab: (finished: waiting for unit setup-gitlab.service, in 196.56 seconds)1592gitlab: waiting for unit nixbot.service1593gitlab # [ 196.191348] nixbot[2626]: {"ts": "2026-10-02T14:13:11.463Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1594gitlab # [ 196.234649] nixbot[2626]: {"ts": "2026-10-02T14:13:11.507Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1595gitlab # [ 196.262723] nixbot[2626]: {"ts": "2026-10-02T14:13:11.535Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1596gitlab # [ 196.271309] nixbot[2626]: {"ts": "2026-10-02T14:13:11.544Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1597gitlab # [ 196.276973] nixbot[2626]: {"ts": "2026-10-02T14:13:11.549Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1598gitlab # [ 196.284087] nixbot[2626]: {"ts": "2026-10-02T14:13:11.556Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1599gitlab # [ 196.289784] nixbot[2626]: {"ts": "2026-10-02T14:13:11.562Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1600gitlab # [ 196.293716] nixbot[2626]: {"ts": "2026-10-02T14:13:11.566Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1601gitlab # [ 196.300568] nixbot[2626]: {"ts": "2026-10-02T14:13:11.573Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1602gitlab # [ 196.304617] nixbot[2626]: {"ts": "2026-10-02T14:13:11.577Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1603gitlab # [ 196.313162] nixbot[2626]: {"ts": "2026-10-02T14:13:11.586Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1604gitlab # [ 196.324567] nixbot[2626]: {"ts": "2026-10-02T14:13:11.597Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1605gitlab # [ 196.330522] nixbot[2626]: {"ts": "2026-10-02T14:13:11.603Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1606gitlab # [ 196.334839] nixbot[2626]: {"ts": "2026-10-02T14:13:11.607Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1607gitlab # [ 196.342304] nixbot[2626]: {"ts": "2026-10-02T14:13:11.615Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1608gitlab # [ 196.346681] nixbot[2626]: {"ts": "2026-10-02T14:13:11.619Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1609gitlab # [ 196.351376] nixbot[2626]: {"ts": "2026-10-02T14:13:11.624Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1610gitlab # [ 196.355376] nixbot[2626]: {"ts": "2026-10-02T14:13:11.628Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1611gitlab # [ 196.361091] nixbot[2626]: {"ts": "2026-10-02T14:13:11.634Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1612gitlab # [ 196.365414] nixbot[2626]: {"ts": "2026-10-02T14:13:11.638Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1613gitlab # [ 196.369605] nixbot[2626]: {"ts": "2026-10-02T14:13:11.642Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1614gitlab # [ 196.378409] nixbot[2626]: {"ts": "2026-10-02T14:13:11.651Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1615gitlab # [ 196.382372] nixbot[2626]: {"ts": "2026-10-02T14:13:11.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1616gitlab # [ 196.386625] nixbot[2626]: {"ts": "2026-10-02T14:13:11.659Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1617gitlab # [ 196.391354] nixbot[2626]: {"ts": "2026-10-02T14:13:11.664Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1618gitlab # [ 196.395801] nixbot[2626]: {"ts": "2026-10-02T14:13:11.668Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1619gitlab # [ 196.400152] nixbot[2626]: {"ts": "2026-10-02T14:13:11.673Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1620gitlab # [ 196.404425] nixbot[2626]: {"ts": "2026-10-02T14:13:11.677Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1621gitlab # [ 196.409114] nixbot[2626]: {"ts": "2026-10-02T14:13:11.682Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1622gitlab # [ 196.426241] nixbot[2626]: {"ts": "2026-10-02T14:13:11.699Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1623gitlab # [ 196.432915] nixbot[2626]: {"ts": "2026-10-02T14:13:11.705Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1624gitlab # [ 196.438586] nixbot[2626]: {"ts": "2026-10-02T14:13:11.711Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1625gitlab # [ 196.442170] nixbot[2626]: {"ts": "2026-10-02T14:13:11.715Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1626gitlab # [ 196.448950] nixbot[2626]: {"ts": "2026-10-02T14:13:11.721Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1627gitlab # [ 196.452330] nixbot[2626]: {"ts": "2026-10-02T14:13:11.725Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1628gitlab # [ 196.462646] nixbot[2626]: {"ts": "2026-10-02T14:13:11.735Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1629gitlab # [ 196.468715] nixbot[2626]: {"ts": "2026-10-02T14:13:11.741Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1630gitlab # [ 196.895977] nixbot[2626]: INFO: Started server process [2626]1631gitlab # [ 196.898529] nixbot[2626]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1632gitlab # [ 196.932774] nixbot[2626]: INFO: ::ffff:127.0.0.1:33324 - "GET /health HTTP/1.1" 200 OK1633gitlab # [ 196.938421] systemd[1]: Started nixbot CI service.1634gitlab # [ 196.940148] systemd[1]: Reached target Multi-User System.1635gitlab # [ 196.941123] systemd[1]: Startup finished in 1.161s (kernel) + 3.583s (initrd) + 3min 12.195s (userspace) = 3min 16.940s.1636gitlab: (finished: waiting for unit nixbot.service, in 1.05 seconds)1637gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1638gitlab # [ 197.047191] nixbot[2626]: INFO: ::ffff:127.0.0.1:33340 - "GET /health HTTP/1.1" 200 OK1639gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1640subtest: project discovered and webhook registered1641gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1642gitlab # [ 197.124195] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 501643gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1644gitlab # [ 197.141169] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2081645gitlab # [ 197.148222] nixbot[2626]: {"ts": "2026-10-02T14:13:12.421Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1646gitlab # [ 197.169991] nixbot[2626]: {"ts": "2026-10-02T14:13:12.443Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1647gitlab # [ 197.212069] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 361648gitlab # [ 197.217825] nixbot[2626]: {"ts": "2026-10-02T14:13:12.490Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1649gitlab # [ 197.224318] nixbot[2626]: {"ts": "2026-10-02T14:13:12.497Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1650gitlab # [ 197.360433] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1291651gitlab # [ 197.365926] nixbot[2626]: {"ts": "2026-10-02T14:13:12.638Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1652gitlab # [ 197.489644] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1111653gitlab # [ 197.495681] nixbot[2626]: {"ts": "2026-10-02T14:13:12.768Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1654gitlab # [ 197.635932] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1251655gitlab # [ 197.641829] nixbot[2626]: {"ts": "2026-10-02T14:13:12.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1656gitlab # [ 197.777378] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1251657gitlab # [ 197.780359] nixbot[2626]: {"ts": "2026-10-02T14:13:13.053Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1658gitlab # [ 197.836619] gitaly[894]: time="2026-10-02T14:13:13.108Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCH74P9R889MKT5682D3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-02T14:13:43.094" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:13.095" grpc.time_ms=13.419 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 197.868852] gitaly[894]: time="2026-10-02T14:13:13.141Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCH74P9R889MKT5682D3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:13:43.140" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:13.141" grpc.time_ms=0.5 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 197.886973] gitaly[894]: time="2026-10-02T14:13:13.160Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCH74P9R889MKT5682D3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-02T14:13:23.024" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:13.154" grpc.time_ms=5.511 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 197.918801] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1311662gitlab # [ 197.922232] nixbot[2626]: {"ts": "2026-10-02T14:13:13.195Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1663gitlab # [ 197.985069] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 591664gitlab # [ 197.988401] nixbot[2626]: {"ts": "2026-10-02T14:13:13.261Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1665gitlab # [ 197.993913] nixbot[2626]: {"ts": "2026-10-02T14:13:13.266Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1666gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1667gitlab # [ 198.107302] gitaly[894]: time="2026-10-02T14:13:13.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCHFKHF5M8B6Q9HZ8CPMP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.369" grpc.time_ms=10.715 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1668gitlab # [ 198.135489] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 761669gitlab # [ 198.222356] gitaly[894]: time="2026-10-02T14:13:13.495Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHJ5X9CWP8JY2EMS7BPJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.487" pid=894 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1670gitlab # [ 198.223110] gitaly[894]: time="2026-10-02T14:13:13.495Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHJ5X9CWP8JY2EMS7BPJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.487" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1671gitlab # [ 198.223842] gitaly[894]: time="2026-10-02T14:13:13.495Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHJ5X9CWP8JY2EMS7BPJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.487" grpc.time_ms=7.872 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1672gitlab # [ 198.224484] gitlab-workhorse[821]: time="2026-10-02T14:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131673gitlab # [ 198.224931] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 831674gitlab # [ 198.274114] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1021675gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1676(finished: subtest: project discovered and webhook registered, in 1.23 seconds)1677subtest: push delivers the webhook1678gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1679gitlab # [ 198.318909] gitaly[894]: time="2026-10-02T14:13:13.592Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHNXZ8R3Q38XAG2RARZF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.582" pid=894 remote_ip="2001:db8:1::1" request_sha=d4cf3d5c91ec18ac2b3a20d606ce2eab1d84e8e9 response_bytes=223 span.kind=server system=grpc1680gitlab # [ 198.328159] gitaly[894]: time="2026-10-02T14:13:13.592Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHNXZ8R3Q38XAG2RARZF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.582" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1681gitlab # [ 198.340240] gitlab-workhorse[821]: time="2026-10-02T14:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231682gitlab # [ 198.342292] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 591683gitlab # [ 198.343084] gitaly[894]: time="2026-10-02T14:13:13.592Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHNXZ8R3Q38XAG2RARZF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.582" grpc.time_ms=9.709 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1684gitlab # [ 198.409599] gitaly[894]: time="2026-10-02T14:13:13.682Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCHSB85PDBFYMGVWVJ7VH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.674" grpc.time_ms=7.86 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1685gitlab # [ 198.410596] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391686gitlab # [ 198.464339] gitaly[894]: time="2026-10-02T14:13:13.737Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHV0N30XERN5HRPBS2QQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.730" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1687gitlab # [ 198.466502] gitaly[894]: time="2026-10-02T14:13:13.737Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHV0N30XERN5HRPBS2QQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.730" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1688gitlab # [ 198.489914] gitaly[894]: time="2026-10-02T14:13:13.762Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCHV0N30XERN5HRPBS2QQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.730" grpc.time_ms=7.19 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1689gitlab # [ 198.502697] gitlab-workhorse[821]: time="2026-10-02T14:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671690gitlab # [ 198.504473] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 661691gitlab # [ 198.580609] gitaly[894]: time="2026-10-02T14:13:13.853Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCHYMJ8MPM8Z8SBXXWRNV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.841" grpc.time_ms=12.069 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1692gitlab # [ 198.582253] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 411693gitlab # [ 198.636372] gitaly[894]: time="2026-10-02T14:13:13.909Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ01PB0E6YEBZW6AB8C0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.893" pid=894 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1694gitlab # [ 198.655559] gitaly[894]: time="2026-10-02T14:13:13.909Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ01PB0E6YEBZW6AB8C0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.893" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1695gitlab # [ 198.668475] gitlab-workhorse[821]: time="2026-10-02T14:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091696gitlab # [ 198.670319] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 521697gitlab # [ 198.672129] gitaly[894]: time="2026-10-02T14:13:13.910Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ01PB0E6YEBZW6AB8C0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:13.893" grpc.time_ms=16.301 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 198.736346] gitaly[894]: time="2026-10-02T14:13:14.009Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:13:44.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:14.008" grpc.time_ms=0.482 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 198.802712] gitaly[894]: time="2026-10-02T14:13:14.075Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-02T14:13:44.066" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:14.066" grpc.time_ms=8.818 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700gitlab # [ 198.847572] gitaly[894]: time="2026-10-02T14:13:14.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:13:24.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:14.111" grpc.time_ms=8.5 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 198.859615] gitaly[894]: time="2026-10-02T14:13:14.132Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:13:24.017" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:14.127" grpc.time_ms=4.921 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 198.910933] gitaly[894]: time="2026-10-02T14:13:14.184Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T14:13:24.053" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:14.183" grpc.time_ms=0.323 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 198.935297] gitaly[894]: time="2026-10-02T14:13:14.208Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T14:13:24.068" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:14.198" grpc.time_ms=9.323 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 198.976221] gitaly[894]: time="2026-10-02T14:13:14.249Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:14.248" grpc.time_ms=0.621 pid=894 span.kind=server system=grpc1705gitlab # [ 199.010561] gitaly[894]: time="2026-10-02T14:13:14.283Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:14.283" grpc.time_ms=0.394 pid=894 span.kind=server system=grpc1706gitlab # [ 199.028618] gitaly[894]: time="2026-10-02T14:13:14.301Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN diskcache=16044c0d-eb10-4511-8101-7310db87f2b7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:13:24.091" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:14.221" pid=894 ref=refs/keep-around/6c5a08f964a408d132ffd4a6650bac31eb24ad16 remote_ip="2001:db8:1::1" revision=6c5a08f964a408d132ffd4a6650bac31eb24ad16 span.kind=server system=grpc username=root1707gitlab # [ 199.031456] gitaly[894]: time="2026-10-02T14:13:14.302Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=67 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5458 command.oublock=8 command.real_time_ms=73 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:13:24.091" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:14.221" grpc.time_ms=80.327 pid=894 ref=refs/keep-around/6c5a08f964a408d132ffd4a6650bac31eb24ad16 remote_ip="2001:db8:1::1" revision=6c5a08f964a408d132ffd4a6650bac31eb24ad16 span.kind=server system=grpc username=root1708gitlab # [ 199.032423] gitaly[894]: time="2026-10-02T14:13:14.305Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:13:44.304" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:14.304" grpc.time_ms=0.509 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 199.248356] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5481710gitlab # [ 199.250751] nixbot[2626]: {"ts": "2026-10-02T14:13:14.521Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1711gitlab # [ 199.267484] nixbot[2626]: {"ts": "2026-10-02T14:13:14.540Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-6c5a08f964a4-0"}1712gitlab # [ 199.421168] nixbot[2626]: {"ts": "2026-10-02T14:13:14.694Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-6c5a08f964a4-0", "argv0": "bwrap"}1713gitlab # [ 199.512223] systemd[1]: Started Nix Daemon.1714gitlab # [ 199.585545] nix-daemon[2786]: accepted connection from pid 2781, user nixbot1715gitlab # [ 204.683842] nix-daemon[2786]: accepted connection from pid 2835, user nixbot1716gitlab # [ 204.701305] nix-daemon[2786]: accepted connection from pid 2781, user nixbot1717gitlab # [ 209.172733] nix-daemon[2786]: accepted connection from pid 2781, user nixbot1718gitlab # [ 209.267539] nix-daemon[2786]: accepted connection from pid 2877, user nixbot1719gitlab # [ 209.308200] gitaly[894]: time="2026-10-02T14:13:24.578Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCWDC9SHHV2B70QCPY7JN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:13:54.574" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:24.575" grpc.time_ms=3.306 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 209.356166] gitaly[894]: time="2026-10-02T14:13:24.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCWDC9SHHV2B70QCPY7JN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:13:34.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:24.622" grpc.time_ms=6.395 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 209.406121] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1521722gitlab # [ 209.412506] nixbot[2626]: {"ts": "2026-10-02T14:13:24.682Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1723gitlab # [ 209.466330] gitaly[894]: time="2026-10-02T14:13:24.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCWJGBFXJR2WJCTP5S0VZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:13:54.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:24.738" grpc.time_ms=0.524 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 209.537765] gitaly[894]: time="2026-10-02T14:13:24.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCWJGBFXJR2WJCTP5S0VZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:13:34.098" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:24.798" grpc.time_ms=11.582 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 209.619504] nixbot[2626]: {"ts": "2026-10-02T14:13:24.892Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1726gitlab # [ 209.621455] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2041727gitlab # [ 213.051657] sidekiq-cluster[2497]: 2026-10-02T14:13:28.323Z pid=2497 tid=xux INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2497, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448012288}1728gitlab # [ 213.215147] sidekiq-cluster[2497]: W, [2026-10-02T14:13:28.488056 #2497] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1729gitlab # [ 213.252127] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:28.524Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1730gitlab # [ 213.601222] nix-daemon[2786]: accepted connection from pid 2948, user nixbot1731gitlab # [ 213.690586] gitaly[894]: time="2026-10-02T14:13:28.962Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD0P6CBZ1GB5V16YQ7GR1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:13:58.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:28.961" grpc.time_ms=0.806 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 213.759976] gitaly[894]: time="2026-10-02T14:13:29.032Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFD0P6CBZ1GB5V16YQ7GR1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:13:39.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:29.022" grpc.time_ms=10.764 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 213.804237] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1741734gitlab # [ 213.810972] nixbot[2626]: {"ts": "2026-10-02T14:13:29.083Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1735gitlab # [ 214.143192] gitaly[894]: time="2026-10-02T14:13:29.416Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFD148RVB946PM47F0XYCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.405" grpc.time_ms=10.988 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1736gitlab # [ 214.171652] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651737gitlab # [ 214.255199] gitaly[894]: time="2026-10-02T14:13:29.528Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD17AC3VM7VPMKDJZCV9D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.515" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1738gitlab # [ 214.277423] gitaly[894]: time="2026-10-02T14:13:29.528Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD17AC3VM7VPMKDJZCV9D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.515" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1739gitlab # [ 214.302112] gitlab-workhorse[821]: time="2026-10-02T14:13:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671740gitlab # [ 214.304602] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 781741gitlab # [ 214.306420] gitaly[894]: time="2026-10-02T14:13:29.529Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD17AC3VM7VPMKDJZCV9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.515" grpc.time_ms=12.711 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 214.369652] gitaly[894]: time="2026-10-02T14:13:29.642Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFD1C0Z7ACXHKVGY7FWVP9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.633" grpc.time_ms=9.055 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1743gitlab # [ 214.394785] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 431744gitlab # [ 214.411235] gitaly[894]: time="2026-10-02T14:13:29.684Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD1DC8PSC81MRXYHMTRMX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.677" pid=894 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1745gitlab # [ 214.420876] gitaly[894]: time="2026-10-02T14:13:29.684Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD1DC8PSC81MRXYHMTRMX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.677" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1746gitlab # [ 214.433208] gitlab-workhorse[821]: time="2026-10-02T14:13:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671747gitlab # [ 214.433772] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 401748gitlab # [ 214.434487] gitaly[894]: time="2026-10-02T14:13:29.684Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFD1DC8PSC81MRXYHMTRMX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:29.677" grpc.time_ms=6.622 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1749gitlab # [ 215.016748] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:30.288Z","message":"GitLab reliable fetch activated!"}1750gitlab # [ 215.018362] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:30.289Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1751gitlab # [ 234.000850] postgres[3164]: [3164] ERROR: relation "table_without_models" does not exist1752gitlab # [ 234.002291] postgres[3164]: [3164] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1753gitlab # [ 236.391672] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:51.664Z","message":"Booted Rails 7.2.3.1 application in production environment"}1754gitlab # [ 236.394682] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:51.667Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1755gitlab # [ 236.395830] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:51.667Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1756gitlab # [ 236.396869] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:51.667Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1757gitlab # [ 236.398020] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:51.669Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1758gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 38.36 seconds)1759gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1760gitlab # [ 236.726398] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 331761gitlab # [ 236.816757] gitaly[894]: time="2026-10-02T14:13:52.089Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQ7Z542AMH6VVE5SF4HF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:52.083" grpc.time_ms=6.244 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1762gitlab # [ 236.817904] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:52 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 901763gitlab # Enumerating objects: 5, done.1764gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1765gitlab # Delta compression using up to 4 threads1766gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1767gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done.1768gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1769gitlab # [ 237.105932] gitaly[894]: time="2026-10-02T14:13:52.378Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-02T14:14:22.368" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-02T14:13:52.368" grpc.time_ms=10.254 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 237.142139] gitaly[894]: time="2026-10-02T14:13:52.415Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M3YFDQCPB94BTS102295BR5Q duration_ms=95ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1771gitlab # [ 237.168716] gitaly[894]: time="2026-10-02T14:13:52.441Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M3YFDQCPB94BTS102295BR5Q duration_ms=25ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1772gitlab # [ 237.169828] gitaly[894]: time="2026-10-02T14:13:52.442Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:52.318" grpc.time_ms=123.554 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1773gitlab # [ 237.222338] gitaly[894]: time="2026-10-02T14:13:52.495Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:52.494" grpc.time_ms=0.481 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1774gitlab # [ 237.266850] gitaly[894]: time="2026-10-02T14:13:52.539Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:52.539" grpc.time_ms=0.258 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1775gitlab # [ 237.297844] gitaly[894]: time="2026-10-02T14:13:52.570Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:52.569" grpc.time_ms=1.209 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1776gitlab # [ 237.365782] gitaly[894]: time="2026-10-02T14:13:52.638Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M3YFDQCPB94BTS102295BR5Q duration_ms=37ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1777gitlab # [ 237.371194] gitaly[894]: time="2026-10-02T14:13:52.644Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:52.601" grpc.time_ms=43.076 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1778gitlab # [ 237.399051] gitaly[894]: time="2026-10-02T14:13:52.672Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q diskcache=5c30dc55-43ed-468e-be08-44d29652523b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:52.236" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1779gitlab # [ 237.408299] gitaly[894]: time="2026-10-02T14:13:52.681Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=201 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13650 command.oublock=32 command.real_time_ms=425 command.spawn_token_fork_ms=0 command.system_time_ms=135 command.user_time_ms=66 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:52.236" grpc.time_ms=444.876 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1780gitlab # [ 237.420583] gitlab-workhorse[821]: time="2026-10-02T14:13:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521781gitlab # [ 237.421249] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:52 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5311782gitlab # To http://gitlab/root/test-flake.git1783gitlab # 6c5a08f..7a63720 master -> master1784gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.80 seconds)1785gitlab: must succeed: git -C /tmp/test-flake rev-parse master1786gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1787gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'1788gitlab # [ 237.500146] nixbot[2626]: INFO: ::ffff:127.0.0.1:45116 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK1789gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.06 seconds)1790gitlab # [ 237.676655] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:52.948Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"90b75a53b533cb16026aedaf","created_at":"2026-10-02T14:13:02.264Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.283Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-90b75a53b533cb16026aedaf: start","job_status":"start","queue_duration_s":50.664732,"scheduling_latency_s":50.664821}1791gitlab # [ 237.923817] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.196Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"90b75a53b533cb16026aedaf","created_at":"2026-10-02T14:13:02.264Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.283Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-90b75a53b533cb16026aedaf: done: 0.247966 sec","job_status":"done","queue_duration_s":50.664732,"scheduling_latency_s":50.664821,"redis_calls":25,"redis_duration_s":0.009197,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.005124,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002266,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.107261398,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.247966,"completed_at":"2026-10-02T14:13:53.195Z","load_balancing_strategy":"primary","db_duration_s":0.063652,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1792gitlab # [ 237.926901] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.198Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"22738def257dea3fb5e9b79b","created_at":"2026-10-02T14:13:02.291Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.294Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-22738def257dea3fb5e9b79b: start","job_status":"start","queue_duration_s":50.903432,"scheduling_latency_s":50.903464}1793gitlab # [ 238.110361] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.383Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"22738def257dea3fb5e9b79b","created_at":"2026-10-02T14:13:02.291Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.294Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-22738def257dea3fb5e9b79b: done: 0.184802 sec","job_status":"done","queue_duration_s":50.903432,"scheduling_latency_s":50.903464,"redis_calls":14,"redis_duration_s":0.004325,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001168,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.083,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.081,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08629057600000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.184802,"completed_at":"2026-10-02T14:13:53.383Z","load_balancing_strategy":"primary","db_duration_s":0.095314,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1794gitlab # [ 238.113415] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.384Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"bf7ba741ee695a9a148593b2","created_at":"2026-10-02T14:13:02.777Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.783Z","job_size_bytes":5,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-bf7ba741ee695a9a148593b2: start","job_status":"start","queue_duration_s":50.601295,"scheduling_latency_s":50.601308}1795gitlab # [ 238.226931] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.499Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"bf7ba741ee695a9a148593b2","created_at":"2026-10-02T14:13:02.777Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.783Z","job_size_bytes":5,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-bf7ba741ee695a9a148593b2: done: 0.115084 sec","job_status":"done","queue_duration_s":50.601295,"scheduling_latency_s":50.601308,"redis_calls":12,"redis_duration_s":0.002713,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000696,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001621,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000366248,"duration_s":0.115084,"completed_at":"2026-10-02T14:13:53.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025305,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1796gitlab # [ 238.228848] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.500Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3a9c5a05432d97b9cad592d9","created_at":"2026-10-02T14:13:02.805Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.808Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3a9c5a05432d97b9cad592d9: start","job_status":"start","queue_duration_s":50.691863,"scheduling_latency_s":50.691876}1797gitlab # [ 238.420221] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.692Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3a9c5a05432d97b9cad592d9","created_at":"2026-10-02T14:13:02.805Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.808Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3a9c5a05432d97b9cad592d9: done: 0.191731 sec","job_status":"done","queue_duration_s":50.691863,"scheduling_latency_s":50.691876,"redis_calls":11,"redis_duration_s":0.002879,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000634,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.163,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.163,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000424356,"duration_s":0.191731,"completed_at":"2026-10-02T14:13:53.692Z","load_balancing_strategy":"primary","db_duration_s":0.064222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1798gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'1799gitlab # [ 238.422727] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.694Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"2bdde155cebd5388b2871ff0","created_at":"2026-10-02T14:13:02.811Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.814Z","job_size_bytes":89,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-2bdde155cebd5388b2871ff0: start","job_status":"start","queue_duration_s":50.879658,"scheduling_latency_s":50.879672}1800gitlab # [ 238.454553] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.720Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"2bdde155cebd5388b2871ff0","created_at":"2026-10-02T14:13:02.811Z","trace_propagation_headers":{"sentry-trace":"1f471415349744c69c574e0dc6144def-556e1ab3868d48e1","baggage":"sentry-trace_id=1f471415349744c69c574e0dc6144def,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFC61ASGW62E1SCYWN7BC4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:02.814Z","job_size_bytes":89,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-2bdde155cebd5388b2871ff0: done: 0.026249 sec","job_status":"done","queue_duration_s":50.879658,"scheduling_latency_s":50.879672,"redis_calls":11,"redis_duration_s":0.002592,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000298642,"duration_s":0.026249,"completed_at":"2026-10-02T14:13:53.720Z","load_balancing_strategy":"primary","db_duration_s":0.005334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1801gitlab # [ 238.512482] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.722Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 6c5a08f964a408d132ffd4a6650bac31eb24ad16 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1641de8bc31ccfc2fc9cad06","created_at":"2026-10-02T14:13:10.092Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-f5bbe37afd5e4ee5","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:13:10.109Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1641de8bc31ccfc2fc9cad06: start","job_status":"start","queue_duration_s":43.612507,"scheduling_latency_s":43.61252}1802gitlab # [ 238.527699] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:53.732Z","message":"changes: \"0000000000000000000000000000000000000000 6c5a08f964a408d132ffd4a6650bac31eb24ad16 refs/heads/master\\n\""}1803gitlab # [ 238.530530] gitaly[894]: time="2026-10-02T14:13:53.764Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:03.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:53.753" grpc.time_ms=10.357 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 238.579051] gitaly[894]: time="2026-10-02T14:13:53.780Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:14:03.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:53.768" grpc.time_ms=11.805 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 238.579876] gitaly[894]: time="2026-10-02T14:13:53.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=10 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-02T14:14:03.062" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:53.812" grpc.time_ms=18.944 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 238.611428] gitaly[894]: time="2026-10-02T14:13:53.884Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:53.884" grpc.time_ms=0.453 pid=894 span.kind=server system=grpc1807gitlab # [ 238.626871] nixbot[2626]: INFO: ::ffff:127.0.0.1:45122 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK1808gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.13 seconds)1809gitlab # [ 238.640452] gitaly[894]: time="2026-10-02T14:13:53.913Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:53.912" grpc.time_ms=0.502 pid=894 span.kind=server system=grpc1810gitlab # [ 238.660097] gitaly[894]: time="2026-10-02T14:13:53.933Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 diskcache=f446f8d7-3da0-4d6c-8bd9-ac6fd108e3ed grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:03.092" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:53.842" pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1811gitlab # [ 238.660803] gitaly[894]: time="2026-10-02T14:13:53.933Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=51 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5113 command.oublock=8 command.real_time_ms=80 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:03.092" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:53.842" grpc.time_ms=90.357 pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1812gitlab # [ 238.694852] gitaly[894]: time="2026-10-02T14:13:53.967Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T14:14:03.216" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:53.967" grpc.time_ms=0.219 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 238.716634] gitaly[894]: time="2026-10-02T14:13:53.989Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-02T14:14:03.230" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:53.980" grpc.time_ms=8.735 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 238.799644] gitaly[894]: time="2026-10-02T14:13:54.072Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-02T14:14:24.064" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:54.065" grpc.time_ms=7.362 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 238.867151] gitaly[894]: time="2026-10-02T14:13:54.140Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T14:14:04.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:54.139" grpc.time_ms=0.374 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 238.900542] gitaly[894]: time="2026-10-02T14:13:54.173Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-02T14:14:04.035" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-02T14:13:54.165" grpc.time_ms=7.745 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 238.929108] gitaly[894]: time="2026-10-02T14:13:54.201Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:04.059" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:54.190" grpc.time_ms=11.475 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 238.961580] gitaly[894]: time="2026-10-02T14:13:54.234Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:04.093" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:54.224" grpc.time_ms=10.242 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 239.000415] gitaly[894]: time="2026-10-02T14:13:54.273Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-02T14:14:24.255" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:54.255" grpc.time_ms=17.595 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 239.334274] gitaly[894]: time="2026-10-02T14:13:54.607Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-02T14:14:04.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:54.605" grpc.time_ms=1.336 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 239.357565] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:54.629Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 6c5a08f964a408d132ffd4a6650bac31eb24ad16 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1641de8bc31ccfc2fc9cad06","created_at":"2026-10-02T14:13:10.092Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-f5bbe37afd5e4ee5","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:13:10.109Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1641de8bc31ccfc2fc9cad06: done: 0.907616 sec","job_status":"done","queue_duration_s":43.612507,"scheduling_latency_s":43.61252,"gitaly_calls":13,"gitaly_duration_s":0.316466,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.042736,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.003903,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.00652,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001688,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004234,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.015977,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010414,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.176,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.209,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.479965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000465981,"exclusive_lock_hold_duration_s":0.025061007000000003,"duration_s":0.907616,"completed_at":"2026-10-02T14:13:54.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.095579,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1822gitlab # [ 239.377664] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:54.631Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6f907e11c5419d0d7accfc06","created_at":"2026-10-02T14:13:14.341Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.347Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6f907e11c5419d0d7accfc06: start","job_status":"start","queue_duration_s":40.283727,"scheduling_latency_s":40.283742}1823gitlab # [ 239.415388] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:54.688Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6f907e11c5419d0d7accfc06","created_at":"2026-10-02T14:13:14.341Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.347Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6f907e11c5419d0d7accfc06: done: 0.057185 sec","job_status":"done","queue_duration_s":40.283727,"scheduling_latency_s":40.283742,"redis_calls":16,"redis_duration_s":0.003581,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001888,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032574,"duration_s":0.057185,"completed_at":"2026-10-02T14:13:54.688Z","load_balancing_strategy":"primary","db_duration_s":0.018239,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1824gitlab # [ 239.438077] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:54.689Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"101a1b1e03471ca4adfdda45","created_at":"2026-10-02T14:13:14.347Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.350Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-101a1b1e03471ca4adfdda45: start","job_status":"start","queue_duration_s":40.338981,"scheduling_latency_s":40.338993}1825gitlab # [ 239.559574] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:54.831Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"101a1b1e03471ca4adfdda45","created_at":"2026-10-02T14:13:14.347Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.350Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-101a1b1e03471ca4adfdda45: done: 0.141919 sec","job_status":"done","queue_duration_s":40.338981,"scheduling_latency_s":40.338993,"redis_calls":21,"redis_duration_s":0.0047220000000000005,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001925,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000543086,"duration_s":0.141919,"completed_at":"2026-10-02T14:13:54.831Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826gitlab # [ 239.561635] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:54.834Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0365789408dc8327761b5667","created_at":"2026-10-02T14:13:14.502Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.507Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0365789408dc8327761b5667: start","job_status":"start","queue_duration_s":40.327058,"scheduling_latency_s":40.327091}1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'1828gitlab # [ 239.668041] nixbot[2626]: INFO: ::ffff:127.0.0.1:45126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK1829gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.04 seconds)1830gitlab # [ 239.711186] gitaly[894]: time="2026-10-02T14:13:54.983Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:54.983" grpc.time_ms=0.345 pid=894 span.kind=server system=grpc1831gitlab # [ 239.740366] gitaly[894]: time="2026-10-02T14:13:55.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:55.013" grpc.time_ms=0.265 pid=894 span.kind=server system=grpc1832gitlab # [ 239.771032] gitaly[894]: time="2026-10-02T14:13:55.044Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:55.043" grpc.time_ms=0.51 pid=894 span.kind=server system=grpc1833gitlab # [ 239.791270] gitaly[894]: time="2026-10-02T14:13:55.064Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN diskcache=787fb75f-4f59-4eab-8b58-5f62beb1c94a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:24.060" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:54.961" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834gitlab # [ 239.791945] gitaly[894]: time="2026-10-02T14:13:55.064Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7251 command.oublock=0 command.real_time_ms=95 command.spawn_token_fork_ms=0 command.system_time_ms=56 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:24.060" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:54.961" grpc.time_ms=103.205 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835gitlab # [ 239.899683] gitaly[894]: time="2026-10-02T14:13:55.172Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:25.170" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.171" grpc.time_ms=1.193 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 239.979822] gitaly[894]: time="2026-10-02T14:13:55.252Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCJ3K4JHSZPCBTSARTHQN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:25.250" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.251" grpc.time_ms=1.052 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 239.998055] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.270Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0365789408dc8327761b5667","created_at":"2026-10-02T14:13:14.502Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.507Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0365789408dc8327761b5667: rescheduled"}1838gitlab # [ 240.012830] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.285Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0365789408dc8327761b5667","created_at":"2026-10-02T14:13:14.502Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-064ffe374dc54a11","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:14.507Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0365789408dc8327761b5667: done: 0.450756 sec","job_status":"done","queue_duration_s":40.327058,"scheduling_latency_s":40.327091,"gitaly_calls":3,"gitaly_duration_s":0.141555,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030559,"redis_read_bytes":460,"redis_write_bytes":29293,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001103,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001466,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011496,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004532,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15581,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006908,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00057,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000633,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002748,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.02,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214494,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.377786004,"duration_s":0.450756,"completed_at":"2026-10-02T14:13:55.285Z","load_balancing_strategy":"primary","db_duration_s":0.073645,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1839gitlab # [ 240.042928] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.287Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","6c5a08f964a408d132ffd4a6650bac31eb24ad16 7a63720443839b5c83b2fd9499e06757fa274d8e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"44209fd2fd9ba77f52f615e2","created_at":"2026-10-02T14:13:52.625Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-09ac38b3814947db","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:13:52.627Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-44209fd2fd9ba77f52f615e2: start","job_status":"start","queue_duration_s":2.66001,"scheduling_latency_s":2.660044}1840gitlab # [ 240.057718] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.300Z","message":"changes: \"6c5a08f964a408d132ffd4a6650bac31eb24ad16 7a63720443839b5c83b2fd9499e06757fa274d8e refs/heads/master\\n\""}1841gitlab # [ 240.059963] gitaly[894]: time="2026-10-02T14:13:55.327Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:05.188" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:55.318" grpc.time_ms=9.029 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 240.123513] gitaly[894]: time="2026-10-02T14:13:55.396Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T14:14:05.257" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:55.388" grpc.time_ms=8.266 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 240.139063] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.411Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"278819cb7c4c536be27c4dbd","created_at":"2026-10-02T14:13:55.410Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"c0e49edd770234c41a72bff1","job_size_bytes":46,"pid":2497,"job_status":"deduplicated","message":"ProjectCacheWorker JID-278819cb7c4c536be27c4dbd: deduplicated: until executing","deduplication.type":"until executing"}1844gitlab # [ 240.153957] gitaly[894]: time="2026-10-02T14:13:55.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-02T14:14:05.290" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:55.421" grpc.time_ms=5.727 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 240.169094] gitaly[894]: time="2026-10-02T14:13:55.442Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-02T14:14:25.430" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.431" grpc.time_ms=10.924 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 240.186386] gitaly[894]: time="2026-10-02T14:13:55.459Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-02T14:14:05.015" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-02T14:13:55.455" grpc.time_ms=3.336 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847gitlab # [ 240.214761] gitaly[894]: time="2026-10-02T14:13:55.487Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:05.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:55.477" grpc.time_ms=10.549 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab # [ 240.272283] gitaly[894]: time="2026-10-02T14:13:55.545Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-02T14:14:05.103" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.544" grpc.time_ms=1.035 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 240.289714] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.562Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","6c5a08f964a408d132ffd4a6650bac31eb24ad16 7a63720443839b5c83b2fd9499e06757fa274d8e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"44209fd2fd9ba77f52f615e2","created_at":"2026-10-02T14:13:52.625Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-09ac38b3814947db","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T14:13:52.627Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-44209fd2fd9ba77f52f615e2: done: 0.274353 sec","job_status":"done","queue_duration_s":2.66001,"scheduling_latency_s":2.660044,"gitaly_calls":7,"gitaly_duration_s":0.14961,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.022382,"redis_read_bytes":501,"redis_write_bytes":11941,"redis_cache_calls":9,"redis_cache_duration_s":0.001986,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000983,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5718,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004051,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007112,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.00825,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000737524,"exclusive_lock_hold_duration_s":0.073392009,"duration_s":0.274353,"completed_at":"2026-10-02T14:13:55.561Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023414,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1850gitlab # [ 240.294950] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.564Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c0e49edd770234c41a72bff1","created_at":"2026-10-02T14:13:53.781Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:53.793Z","job_size_bytes":46,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c0e49edd770234c41a72bff1: start","job_status":"start","queue_duration_s":1.770367,"scheduling_latency_s":1.770405}1851gitlab # [ 240.342715] gitaly[894]: time="2026-10-02T14:13:55.615Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-02T20:13:55.613" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:55.613" grpc.time_ms=2.174 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 240.352788] gitaly[894]: time="2026-10-02T14:13:55.625Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-02T14:14:25.019" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.620" grpc.time_ms=5.628 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 240.370736] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.642Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c0e49edd770234c41a72bff1","created_at":"2026-10-02T14:13:53.781Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:53.793Z","job_size_bytes":46,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-c0e49edd770234c41a72bff1: done: 0.078777 sec","job_status":"done","queue_duration_s":1.770367,"scheduling_latency_s":1.770405,"gitaly_calls":2,"gitaly_duration_s":0.010778,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.005048,"redis_read_bytes":69,"redis_write_bytes":4880,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001217,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000316,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001845,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192761,"duration_s":0.078777,"completed_at":"2026-10-02T14:13:55.642Z","load_balancing_strategy":"primary","db_duration_s":0.008791,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1854gitlab # [ 240.377878] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.644Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2b17b9786d51fce1a2c210cf","created_at":"2026-10-02T14:13:53.806Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:53.809Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2b17b9786d51fce1a2c210cf: start","job_status":"start","queue_duration_s":1.834867,"scheduling_latency_s":1.834881}1855gitlab # [ 240.408956] gitaly[894]: time="2026-10-02T14:13:55.682Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 diskcache=1ea5ef9a-3f6c-44e1-9c98-4770c896fc04 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T20:13:55.660" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.661" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 240.409803] gitaly[894]: time="2026-10-02T14:13:55.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1280 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T20:13:55.660" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.661" grpc.time_ms=20.9 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 240.433759] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.706Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2b17b9786d51fce1a2c210cf","created_at":"2026-10-02T14:13:53.806Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:53.809Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2b17b9786d51fce1a2c210cf: done: 0.062566 sec","job_status":"done","queue_duration_s":1.834867,"scheduling_latency_s":1.834881,"gitaly_calls":1,"gitaly_duration_s":0.022819,"redis_calls":15,"redis_duration_s":0.002135,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000431,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.046581618,"duration_s":0.062566,"completed_at":"2026-10-02T14:13:55.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 240.457086] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.707Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"496a590f6c635fd2780cb236","created_at":"2026-10-02T14:13:53.963Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:53.965Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-496a590f6c635fd2780cb236: start","job_status":"start","queue_duration_s":1.742576,"scheduling_latency_s":1.742589}1859gitlab # [ 240.471471] gitaly[894]: time="2026-10-02T14:13:55.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-02T14:14:25.123" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.724" grpc.time_ms=5.021 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 240.483054] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.734Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"496a590f6c635fd2780cb236","created_at":"2026-10-02T14:13:53.963Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:53.965Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-496a590f6c635fd2780cb236: done: 0.027305 sec","job_status":"done","queue_duration_s":1.742576,"scheduling_latency_s":1.742589,"gitaly_calls":1,"gitaly_duration_s":0.006673,"redis_calls":16,"redis_duration_s":0.00208,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000166,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00094,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027305,"completed_at":"2026-10-02T14:13:55.734Z","load_balancing_strategy":"primary","db_duration_s":0.00171,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1861gitlab # [ 240.523239] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:55.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a21607e33581022614d83848","created_at":"2026-10-02T14:13:54.490Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7a654ac308baeef7ee2e7e80f7a6415d9a6fe3d3bcabe6eb24a05f0f6b131117","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:54.493Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a21607e33581022614d83848: start","job_status":"start","queue_duration_s":1.241909,"scheduling_latency_s":1.241924}1862gitlab # [ 240.575854] gitaly[894]: time="2026-10-02T14:13:55.751Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:25.150" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.751" grpc.time_ms=0.403 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 240.576610] gitaly[894]: time="2026-10-02T14:13:55.757Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T14:14:05.152" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:55.752" grpc.time_ms=4.388 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 240.577255] gitaly[894]: time="2026-10-02T14:13:55.824Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:25.223" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.823" grpc.time_ms=0.647 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 240.577817] gitaly[894]: time="2026-10-02T14:13:55.828Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-02T14:14:25.226" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:55.826" grpc.time_ms=1.546 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 240.606347] gitaly[894]: time="2026-10-02T14:13:55.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:05.274" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:55.874" grpc.time_ms=4.73 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'1868gitlab # [ 240.710498] nixbot[2626]: INFO: ::ffff:127.0.0.1:45136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK1869gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.04 seconds)1870gitlab # [ 240.963878] gitaly[894]: time="2026-10-02T14:13:56.236Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-02T14:14:26.018" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:56.218" grpc.time_ms=17.302 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 240.996644] gitaly[894]: time="2026-10-02T14:13:56.252Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFCDRN6Y9C8J0K2CB8YK97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-02T14:14:26.037" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:56.238" grpc.time_ms=14.495 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 241.021215] sidekiq-cluster[2497]: {"severity":"WARN","time":"2026-10-02T14:13:56.271Z","class":"CreatePipelineWorker","correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"6c5a08f964a408d132ffd4a6650bac31eb24ad16","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"6c5a08f964a408d132ffd4a6650bac31eb24ad16","ref":"refs/heads/master"},"retry":0}1873gitlab # [ 241.022491] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.276Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a21607e33581022614d83848","created_at":"2026-10-02T14:13:54.490Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7a654ac308baeef7ee2e7e80f7a6415d9a6fe3d3bcabe6eb24a05f0f6b131117","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:54.493Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a21607e33581022614d83848: done: 0.5405 sec","job_status":"done","queue_duration_s":1.241909,"scheduling_latency_s":1.241924,"gitaly_calls":7,"gitaly_duration_s":0.054068,"redis_calls":51,"redis_duration_s":0.007162,"redis_read_bytes":169,"redis_write_bytes":4166,"redis_cache_calls":4,"redis_cache_duration_s":0.000545,"redis_cache_read_bytes":10,"redis_cache_write_bytes":341,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003242,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001585,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.442672,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000326019,"duration_s":0.5405,"completed_at":"2026-10-02T14:13:56.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033829,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1874gitlab # [ 241.033160] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.277Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ded3350b-05e4-4f8f-ad7f-a589f76c95b7\"}"],"class":"WebHookWorker","jid":"64f6b0ffd28c7a241e5f0a4a","created_at":"2026-10-02T14:13:54.582Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4c059c1148d5202630ba4332f77219c5de44d6ce128ba59c4e9426abfb2dc739","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:54.587Z","job_size_bytes":1751,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-64f6b0ffd28c7a241e5f0a4a: start","job_status":"start","queue_duration_s":1.690646,"scheduling_latency_s":1.69066}1875gitlab # [ 241.215258] nixbot[2626]: INFO: ::ffff:127.0.0.1:45148 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1876gitlab # [ 241.237120] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.509Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ded3350b-05e4-4f8f-ad7f-a589f76c95b7\"}"],"class":"WebHookWorker","jid":"64f6b0ffd28c7a241e5f0a4a","created_at":"2026-10-02T14:13:54.582Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-7f68fe2e4173467f","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4c059c1148d5202630ba4332f77219c5de44d6ce128ba59c4e9426abfb2dc739","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:54.587Z","job_size_bytes":1751,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-64f6b0ffd28c7a241e5f0a4a: done: 0.231983 sec","job_status":"done","queue_duration_s":1.690646,"scheduling_latency_s":1.69066,"redis_calls":19,"redis_duration_s":0.004354,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001195,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000391,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.07,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.06034426200000098,"cpu_s":0.088827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041374,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.231983,"completed_at":"2026-10-02T14:13:56.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 241.318286] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"857534d804c348888dd770de","created_at":"2026-10-02T14:13:54.938Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:54.946Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-857534d804c348888dd770de: start","job_status":"start","queue_duration_s":1.644158,"scheduling_latency_s":1.644187}1878gitlab # [ 241.333396] gitaly[894]: time="2026-10-02T14:13:56.600Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDVN9BAJJP77VJKMMQFG9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:56.591" grpc.time_ms=9.246 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1879gitlab # [ 241.334753] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 801880gitlab # [ 241.398116] gitaly[894]: time="2026-10-02T14:13:56.671Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDVQVZZ4AC4RMYZ757JSX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:56.661" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1881gitlab # [ 241.399198] gitaly[894]: time="2026-10-02T14:13:56.671Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDVQVZZ4AC4RMYZ757JSX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:56.661" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1882gitlab # [ 241.399854] gitaly[894]: time="2026-10-02T14:13:56.672Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDVQVZZ4AC4RMYZ757JSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:56.661" grpc.time_ms=10.11 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1883gitlab # [ 241.422060] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.694Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"857534d804c348888dd770de","created_at":"2026-10-02T14:13:54.938Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:54.946Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-857534d804c348888dd770de: done: 0.103122 sec","job_status":"done","queue_duration_s":1.644158,"scheduling_latency_s":1.644187,"redis_calls":10,"redis_duration_s":0.002572,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001062,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000395,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203377,"duration_s":0.103122,"completed_at":"2026-10-02T14:13:56.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024977,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1884gitlab # [ 241.432115] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.695Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a654da404bdb11ad8cc9fc2d","created_at":"2026-10-02T14:13:55.072Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.079Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a654da404bdb11ad8cc9fc2d: start","job_status":"start","queue_duration_s":1.61555,"scheduling_latency_s":1.615563}1885gitlab # [ 241.447269] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.717Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a654da404bdb11ad8cc9fc2d","created_at":"2026-10-02T14:13:55.072Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.079Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a654da404bdb11ad8cc9fc2d: done: 0.022826 sec","job_status":"done","queue_duration_s":1.61555,"scheduling_latency_s":1.615563,"redis_calls":10,"redis_duration_s":0.001403,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213435,"duration_s":0.022826,"completed_at":"2026-10-02T14:13:56.717Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1886gitlab # [ 241.501082] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"be67ae45f86bcf72a3e48a9d","created_at":"2026-10-02T14:13:55.095Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.103Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-be67ae45f86bcf72a3e48a9d: start","job_status":"start","queue_duration_s":1.615931,"scheduling_latency_s":1.615944}1887gitlab # [ 241.501813] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.739Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"be67ae45f86bcf72a3e48a9d","created_at":"2026-10-02T14:13:55.095Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.103Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-be67ae45f86bcf72a3e48a9d: done: 0.020298 sec","job_status":"done","queue_duration_s":1.615931,"scheduling_latency_s":1.615944,"redis_calls":10,"redis_duration_s":0.001218,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197511,"duration_s":0.020298,"completed_at":"2026-10-02T14:13:56.739Z","load_balancing_strategy":"primary","db_duration_s":0.002753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1888gitlab # [ 241.556216] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.740Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1d43386f5726905370c089df","created_at":"2026-10-02T14:13:55.117Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.122Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1d43386f5726905370c089df: start","job_status":"start","queue_duration_s":1.617219,"scheduling_latency_s":1.617233}1889gitlab # [ 241.556866] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1d43386f5726905370c089df","created_at":"2026-10-02T14:13:55.117Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.122Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1d43386f5726905370c089df: done: 0.021575 sec","job_status":"done","queue_duration_s":1.617219,"scheduling_latency_s":1.617233,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000367,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197232,"duration_s":0.021575,"completed_at":"2026-10-02T14:13:56.761Z","load_balancing_strategy":"primary","db_duration_s":0.002786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1890gitlab # [ 241.597592] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5eee259d8046318eb25171b3","created_at":"2026-10-02T14:13:55.123Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.128Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5eee259d8046318eb25171b3: start","job_status":"start","queue_duration_s":1.633825,"scheduling_latency_s":1.633838}1891gitlab # [ 241.605856] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.781Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5eee259d8046318eb25171b3","created_at":"2026-10-02T14:13:55.123Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.128Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5eee259d8046318eb25171b3: done: 0.018736 sec","job_status":"done","queue_duration_s":1.633825,"scheduling_latency_s":1.633838,"redis_calls":10,"redis_duration_s":0.0012560000000000002,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192483,"duration_s":0.018736,"completed_at":"2026-10-02T14:13:56.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1892gitlab # [ 241.676335] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.782Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2807754ebae339101fa6a605","created_at":"2026-10-02T14:13:55.129Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.133Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2807754ebae339101fa6a605: start","job_status":"start","queue_duration_s":1.648334,"scheduling_latency_s":1.648347}1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'1894gitlab # [ 241.676992] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2807754ebae339101fa6a605","created_at":"2026-10-02T14:13:55.129Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.133Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2807754ebae339101fa6a605: done: 0.020676 sec","job_status":"done","queue_duration_s":1.648334,"scheduling_latency_s":1.648347,"redis_calls":11,"redis_duration_s":0.0016409999999999999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206731,"duration_s":0.020676,"completed_at":"2026-10-02T14:13:56.802Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1895gitlab # [ 241.697859] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.803Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8aa3b82aa0e8c690ba381a5b","created_at":"2026-10-02T14:13:55.135Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.138Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8aa3b82aa0e8c690ba381a5b: start","job_status":"start","queue_duration_s":1.665476,"scheduling_latency_s":1.66549}1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.06 seconds)1897gitlab # [ 241.742804] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.823Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8aa3b82aa0e8c690ba381a5b","created_at":"2026-10-02T14:13:55.135Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.138Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8aa3b82aa0e8c690ba381a5b: done: 0.01951 sec","job_status":"done","queue_duration_s":1.665476,"scheduling_latency_s":1.66549,"redis_calls":10,"redis_duration_s":0.00131,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193879,"duration_s":0.01951,"completed_at":"2026-10-02T14:13:56.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1898gitlab # [ 241.788283] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"37c02941a55750601cc69d72","created_at":"2026-10-02T14:13:55.139Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.141Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-37c02941a55750601cc69d72: start","job_status":"start","queue_duration_s":1.682582,"scheduling_latency_s":1.682594}1899gitlab # [ 241.789268] nixbot[2626]: INFO: ::ffff:127.0.0.1:45164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK1900gitlab # [ 241.789750] gitaly[894]: time="2026-10-02T14:13:57.055Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q diskcache=a1f82674-244f-49aa-8342-ef6e038cda10 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T20:13:57.044" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.045" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 241.790503] gitaly[894]: time="2026-10-02T14:13:57.055Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T20:13:57.044" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.045" grpc.time_ms=10.087 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 241.791181] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"37c02941a55750601cc69d72","created_at":"2026-10-02T14:13:55.139Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.141Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-37c02941a55750601cc69d72: done: 0.022666 sec","job_status":"done","queue_duration_s":1.682582,"scheduling_latency_s":1.682594,"redis_calls":10,"redis_duration_s":0.001225,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195276,"duration_s":0.022666,"completed_at":"2026-10-02T14:13:56.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1903gitlab # [ 241.853302] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.848Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"349865a5bd8614a5724e4e1e","created_at":"2026-10-02T14:13:55.146Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.149Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-349865a5bd8614a5724e4e1e: start","job_status":"start","queue_duration_s":1.698951,"scheduling_latency_s":1.698963}1904gitlab # [ 241.853976] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.869Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"349865a5bd8614a5724e4e1e","created_at":"2026-10-02T14:13:55.146Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.149Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-349865a5bd8614a5724e4e1e: done: 0.021119 sec","job_status":"done","queue_duration_s":1.698951,"scheduling_latency_s":1.698963,"redis_calls":10,"redis_duration_s":0.001235,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196114,"duration_s":0.021119,"completed_at":"2026-10-02T14:13:56.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1905gitlab # [ 241.911743] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4decd029dd148ed2ebb1f4e3","created_at":"2026-10-02T14:13:55.149Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.152Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4decd029dd148ed2ebb1f4e3: start","job_status":"start","queue_duration_s":1.717974,"scheduling_latency_s":1.717986}1906gitlab # [ 241.912587] gitaly[894]: time="2026-10-02T14:13:57.081Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:27.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.080" grpc.time_ms=0.418 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 241.913257] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.884Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4decd029dd148ed2ebb1f4e3","created_at":"2026-10-02T14:13:55.149Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.152Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4decd029dd148ed2ebb1f4e3: done: 0.014633 sec","job_status":"done","queue_duration_s":1.717974,"scheduling_latency_s":1.717986,"redis_calls":10,"redis_duration_s":0.002408,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191365,"duration_s":0.014633,"completed_at":"2026-10-02T14:13:56.884Z","load_balancing_strategy":"primary","db_duration_s":0.001235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1908gitlab # [ 241.969733] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6cad7e0b44b22c7ef299a8f4","created_at":"2026-10-02T14:13:55.152Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.155Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6cad7e0b44b22c7ef299a8f4: start","job_status":"start","queue_duration_s":1.730566,"scheduling_latency_s":1.730578}1909gitlab # [ 241.970933] gitaly[894]: time="2026-10-02T14:13:57.087Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T14:14:07.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:57.082" grpc.time_ms=4.825 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 241.971616] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6cad7e0b44b22c7ef299a8f4","created_at":"2026-10-02T14:13:55.152Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.155Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6cad7e0b44b22c7ef299a8f4: done: 0.079019 sec","job_status":"done","queue_duration_s":1.730566,"scheduling_latency_s":1.730578,"redis_calls":10,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000250031,"duration_s":0.079019,"completed_at":"2026-10-02T14:13:56.964Z","load_balancing_strategy":"primary","db_duration_s":0.003403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1911gitlab # [ 242.012773] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:56.965Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"2c5cca53f324ea7dc801699d","created_at":"2026-10-02T14:13:55.159Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.162Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-2c5cca53f324ea7dc801699d: start","job_status":"start","queue_duration_s":1.802914,"scheduling_latency_s":1.802929}1912gitlab # [ 242.051254] gitaly[894]: time="2026-10-02T14:13:57.107Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:27.106" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.106" grpc.time_ms=0.438 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab # [ 242.051860] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.006Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"2c5cca53f324ea7dc801699d","created_at":"2026-10-02T14:13:55.159Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.162Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-2c5cca53f324ea7dc801699d: done: 0.040766 sec","job_status":"done","queue_duration_s":1.802914,"scheduling_latency_s":1.802929,"redis_calls":14,"redis_duration_s":0.001925,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225447,"duration_s":0.040766,"completed_at":"2026-10-02T14:13:57.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1914gitlab # [ 242.096767] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.007Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8cb37ff58b68cdaded6cfc76","created_at":"2026-10-02T14:13:55.271Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.274Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8cb37ff58b68cdaded6cfc76: start","job_status":"start","queue_duration_s":1.733489,"scheduling_latency_s":1.733502}1915gitlab # [ 242.097727] gitaly[894]: time="2026-10-02T14:13:57.110Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=38 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-02T14:14:27.108" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.108" grpc.time_ms=1.195 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 242.098582] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.028Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8cb37ff58b68cdaded6cfc76","created_at":"2026-10-02T14:13:55.271Z","trace_propagation_headers":{"sentry-trace":"215bde5a99704e2697ca6449ee7c5ed7-01374069e30e4f71","baggage":"sentry-trace_id=215bde5a99704e2697ca6449ee7c5ed7,sentry-release=Unknown"},"correlation_id":"01M3YFCJ3K4JHSZPCBTSARTHQN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.274Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8cb37ff58b68cdaded6cfc76: done: 0.020626 sec","job_status":"done","queue_duration_s":1.733489,"scheduling_latency_s":1.733502,"redis_calls":8,"redis_duration_s":0.00372,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002918,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020626,"completed_at":"2026-10-02T14:13:57.028Z","load_balancing_strategy":"primary","db_duration_s":0.003087,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1917gitlab # [ 242.138688] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.029Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5e42aa4eaf4472adb9af71c7","created_at":"2026-10-02T14:13:55.416Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"2b17b9786d51fce1a2c210cf","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.417Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5e42aa4eaf4472adb9af71c7: start","job_status":"start","queue_duration_s":1.611674,"scheduling_latency_s":1.611688}1918gitlab # [ 242.176369] gitaly[894]: time="2026-10-02T14:13:57.197Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:07.112" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:57.193" grpc.time_ms=4.791 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 242.177034] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.065Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5e42aa4eaf4472adb9af71c7","created_at":"2026-10-02T14:13:55.416Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"2b17b9786d51fce1a2c210cf","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.417Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5e42aa4eaf4472adb9af71c7: done: 0.036131 sec","job_status":"done","queue_duration_s":1.611674,"scheduling_latency_s":1.611688,"gitaly_calls":1,"gitaly_duration_s":0.011918,"redis_calls":12,"redis_duration_s":0.002117,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000872,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02218131,"duration_s":0.036131,"completed_at":"2026-10-02T14:13:57.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1920gitlab # [ 242.197586] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.066Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b74fc978740d1e873fe7f18d","created_at":"2026-10-02T14:13:55.523Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2666f72c14f1e2d4ec1d7602c7110bfd4a8ca7630fda97ed0407e2c9d655198c","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.524Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b74fc978740d1e873fe7f18d: start","job_status":"start","queue_duration_s":1.541616,"scheduling_latency_s":1.54163}1921gitlab # [ 242.252295] gitlab-workhorse[821]: time="2026-10-02T14:13:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671922gitlab # [ 242.254644] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 9211923gitlab # [ 242.257286] gitaly[894]: time="2026-10-02T14:13:57.530Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=20 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=20 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-02T14:14:27.300" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.500" grpc.time_ms=29.152 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 242.272918] gitaly[894]: time="2026-10-02T14:13:57.546Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDQCPB94BTS102295BR5Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-02T14:14:27.333" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:57.534" grpc.time_ms=11.826 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 242.287677] sidekiq-cluster[2497]: {"severity":"WARN","time":"2026-10-02T14:13:57.560Z","class":"CreatePipelineWorker","correlation_id":"01M3YFDQCPB94BTS102295BR5Q","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"6c5a08f964a408d132ffd4a6650bac31eb24ad16","after":"7a63720443839b5c83b2fd9499e06757fa274d8e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"7a63720443839b5c83b2fd9499e06757fa274d8e","ref":"refs/heads/master"},"retry":0}1926gitlab # [ 242.291902] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.564Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b74fc978740d1e873fe7f18d","created_at":"2026-10-02T14:13:55.523Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2666f72c14f1e2d4ec1d7602c7110bfd4a8ca7630fda97ed0407e2c9d655198c","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.524Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b74fc978740d1e873fe7f18d: done: 0.498163 sec","job_status":"done","queue_duration_s":1.541616,"scheduling_latency_s":1.54163,"gitaly_calls":7,"gitaly_duration_s":0.130174,"redis_calls":33,"redis_duration_s":0.0034100000000000003,"redis_read_bytes":184,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000341,"redis_cache_read_bytes":43,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001579,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.399632,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.498163,"completed_at":"2026-10-02T14:13:57.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032027,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1927gitlab # [ 242.332786] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.567Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9f62e6ca-a00c-4f5f-a12a-c7782086dbfc\"}"],"class":"WebHookWorker","jid":"baeee7364e380ae1f6854dff","created_at":"2026-10-02T14:13:55.534Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4c13a34c8fdfb7146a9c82f2aa211d1567b78b49a91cc4d33eb99e29fe6fac18","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.535Z","job_size_bytes":1749,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-baeee7364e380ae1f6854dff: start","job_status":"start","queue_duration_s":2.031049,"scheduling_latency_s":2.031071}1928gitlab # [ 242.333404] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.595Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9f62e6ca-a00c-4f5f-a12a-c7782086dbfc\"}"],"class":"WebHookWorker","jid":"baeee7364e380ae1f6854dff","created_at":"2026-10-02T14:13:55.534Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-94d27582495c4091","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4c13a34c8fdfb7146a9c82f2aa211d1567b78b49a91cc4d33eb99e29fe6fac18","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.535Z","job_size_bytes":1749,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-baeee7364e380ae1f6854dff: done: 0.028383 sec","job_status":"done","queue_duration_s":2.031049,"scheduling_latency_s":2.031071,"redis_calls":14,"redis_duration_s":0.001478,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000171,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006102171999998518,"cpu_s":0.016963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.028383,"completed_at":"2026-10-02T14:13:57.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1929gitlab # [ 242.379888] nixbot[2626]: INFO: ::ffff:127.0.0.1:45170 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1930gitlab # [ 242.380433] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a77d806d6586824d1bc3d863","created_at":"2026-10-02T14:13:55.633Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-fb5c6b5c9e824e1a","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.636Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a77d806d6586824d1bc3d863: start","job_status":"start","queue_duration_s":1.961377,"scheduling_latency_s":1.961392}1931gitlab # [ 242.381044] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a77d806d6586824d1bc3d863","created_at":"2026-10-02T14:13:55.633Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-fb5c6b5c9e824e1a","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:55.636Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a77d806d6586824d1bc3d863: done: 0.031671 sec","job_status":"done","queue_duration_s":1.961377,"scheduling_latency_s":1.961392,"redis_calls":19,"redis_duration_s":0.002291,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000304,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0044377159999999995,"duration_s":0.031671,"completed_at":"2026-10-02T14:13:57.629Z","load_balancing_strategy":"primary","db_duration_s":0.008255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1932gitlab # [ 242.433172] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.630Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","64f6b0ffd28c7a241e5f0a4a"],"class":"WebHooks::LogExecutionWorker","jid":"7a37add4064c0f3d0561a83f","created_at":"2026-10-02T14:13:56.491Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-f26e5a5b85eb433c","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c3db1b63c901a6fe67e6b320a589832bdda7db5e6a83a91c05a1e7de0886cfe5","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:56.500Z","job_size_bytes":2593,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7a37add4064c0f3d0561a83f: start","job_status":"start","queue_duration_s":1.129797,"scheduling_latency_s":1.12981}1933gitlab # [ 242.433817] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.657Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","64f6b0ffd28c7a241e5f0a4a"],"class":"WebHooks::LogExecutionWorker","jid":"7a37add4064c0f3d0561a83f","created_at":"2026-10-02T14:13:56.491Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-f26e5a5b85eb433c","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c3db1b63c901a6fe67e6b320a589832bdda7db5e6a83a91c05a1e7de0886cfe5","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:56.500Z","job_size_bytes":2593,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7a37add4064c0f3d0561a83f: done: 0.027189 sec","job_status":"done","queue_duration_s":1.129797,"scheduling_latency_s":1.12981,"redis_calls":10,"redis_duration_s":0.001379,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000211759,"duration_s":0.027189,"completed_at":"2026-10-02T14:13:57.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1934gitlab # [ 242.486686] gitlab-workhorse[821]: time="2026-10-02T14:13:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371935gitlab # [ 242.487498] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1271936gitlab # [ 242.488034] gitaly[894]: time="2026-10-02T14:13:57.657Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDWMT49T1EYTDMQSX6V4C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:57.605" pid=894 remote_ip="2001:db8:1::1" request_sha=c0a4ab71a6787c08382d8aaaf0b5fb006583b3a9 response_bytes=337 span.kind=server system=grpc1937gitlab # [ 242.488550] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.658Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","baeee7364e380ae1f6854dff"],"class":"WebHooks::LogExecutionWorker","jid":"63903b4e87a600114391b8a3","created_at":"2026-10-02T14:13:57.590Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-02ee67243f1d456f","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:046f19baebb08adbbf2f5633c4b3122f74141ad55c579b750eb53d41bada8a8d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:57.592Z","job_size_bytes":2592,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-63903b4e87a600114391b8a3: start","job_status":"start","queue_duration_s":0.066481,"scheduling_latency_s":0.066494}1938gitlab # [ 242.492539] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.674Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","baeee7364e380ae1f6854dff"],"class":"WebHooks::LogExecutionWorker","jid":"63903b4e87a600114391b8a3","created_at":"2026-10-02T14:13:57.590Z","trace_propagation_headers":{"sentry-trace":"64ea60c74eb34592bc1468f2a49d7593-02ee67243f1d456f","baggage":"sentry-trace_id=64ea60c74eb34592bc1468f2a49d7593,sentry-release=Unknown"},"correlation_id":"01M3YFDQCPB94BTS102295BR5Q","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:046f19baebb08adbbf2f5633c4b3122f74141ad55c579b750eb53d41bada8a8d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:57.592Z","job_size_bytes":2592,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-63903b4e87a600114391b8a3: done: 0.015989 sec","job_status":"done","queue_duration_s":0.066481,"scheduling_latency_s":0.066494,"redis_calls":7,"redis_duration_s":0.001928,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015989,"completed_at":"2026-10-02T14:13:57.674Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1939gitlab # [ 242.549477] gitaly[894]: time="2026-10-02T14:13:57.657Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=50 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDWMT49T1EYTDMQSX6V4C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:57.605" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1940gitlab # [ 242.550308] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6bf65c64f049449c7a338bc1","created_at":"2026-10-02T14:13:57.621Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-8f214885423b4cdf","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:57.624Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6bf65c64f049449c7a338bc1: start","job_status":"start","queue_duration_s":0.050976,"scheduling_latency_s":0.05099}1941gitlab # [ 242.557621] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:57.726Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6bf65c64f049449c7a338bc1","created_at":"2026-10-02T14:13:57.621Z","trace_propagation_headers":{"sentry-trace":"da783543a74b42eaa47bb64f9edc142e-8f214885423b4cdf","baggage":"sentry-trace_id=da783543a74b42eaa47bb64f9edc142e,sentry-release=Unknown"},"correlation_id":"01M3YFCDRN6Y9C8J0K2CB8YK97","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:57.624Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6bf65c64f049449c7a338bc1: done: 0.051034 sec","job_status":"done","queue_duration_s":0.050976,"scheduling_latency_s":0.05099,"redis_calls":11,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197791,"duration_s":0.051034,"completed_at":"2026-10-02T14:13:57.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1942gitlab # [ 242.609196] gitaly[894]: time="2026-10-02T14:13:57.657Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=50 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDWMT49T1EYTDMQSX6V4C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:57.605" grpc.time_ms=51.878 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1943gitlab # [ 242.670469] nixbot[2626]: {"ts": "2026-10-02T14:13:57.943Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1944gitlab # [ 242.734619] gitaly[894]: time="2026-10-02T14:13:58.007Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX1K4VSS9RTZS3Q2QC8T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.000" grpc.time_ms=6.721 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1945gitlab # [ 242.746747] gitaly[894]: time="2026-10-02T14:13:58.018Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:28.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.018" grpc.time_ms=0.493 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 242.747513] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 691947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'1948gitlab # [ 242.781878] gitaly[894]: time="2026-10-02T14:13:58.054Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX3V84Y80HX98WYREVFQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.048" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1949gitlab # [ 242.782575] gitaly[894]: time="2026-10-02T14:13:58.055Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX3V84Y80HX98WYREVFQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.048" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1950gitlab # [ 242.783410] gitaly[894]: time="2026-10-02T14:13:58.055Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX3V84Y80HX98WYREVFQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.048" grpc.time_ms=6.399 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1951gitlab # [ 242.783971] gitlab-workhorse[821]: time="2026-10-02T14:13:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671952gitlab # [ 242.784559] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 441953gitlab # [ 242.805669] gitaly[894]: time="2026-10-02T14:13:58.078Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:08.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.073" grpc.time_ms=4.854 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.07 seconds)1955gitlab # [ 242.829664] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.102Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6cccf3282843be127a6b7275","created_at":"2026-10-02T14:13:58.099Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-c00469e02a844b90","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.101Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6cccf3282843be127a6b7275: start","job_status":"start","queue_duration_s":0.00141,"scheduling_latency_s":0.001438}1956gitlab # [ 242.835287] nixbot[2626]: INFO: ::ffff:127.0.0.1:45184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK1957gitlab # [ 242.843857] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1611958gitlab # [ 242.844703] nixbot[2626]: {"ts": "2026-10-02T14:13:58.117Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1959gitlab # [ 242.884054] gitaly[894]: time="2026-10-02T14:13:58.157Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX782T7DVEN3GXEVQGH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:28.155" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.156" grpc.time_ms=0.89 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 242.909574] gitaly[894]: time="2026-10-02T14:13:58.182Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX7X6ACJD15F3PNXQFFN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.177" grpc.time_ms=5.217 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1961gitlab # [ 242.921757] gitaly[894]: time="2026-10-02T14:13:58.187Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX782T7DVEN3GXEVQGH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:08.160" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.181" grpc.time_ms=5.971 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 242.933920] gitaly[894]: time="2026-10-02T14:13:58.189Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:58.189" grpc.time_ms=0.227 pid=894 span.kind=server system=grpc1963gitlab # [ 242.942787] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 411964gitlab # [ 242.950609] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1031965gitlab # [ 242.953207] nixbot[2626]: {"ts": "2026-10-02T14:13:58.225Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1966gitlab # [ 242.955833] gitaly[894]: time="2026-10-02T14:13:58.226Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:58.226" grpc.time_ms=0.262 pid=894 span.kind=server system=grpc1967gitlab # [ 242.972484] gitaly[894]: time="2026-10-02T14:13:58.245Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:58.244" grpc.time_ms=0.18 pid=894 span.kind=server system=grpc1968gitlab # [ 242.985493] gitaly[894]: time="2026-10-02T14:13:58.258Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX99F7E2DYF4PQQFCK5A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.239" pid=894 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1969gitlab # [ 242.986311] gitaly[894]: time="2026-10-02T14:13:58.258Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1176 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX99F7E2DYF4PQQFCK5A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.239" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1970gitlab # [ 242.986980] gitaly[894]: time="2026-10-02T14:13:58.259Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW diskcache=977075d8-3a8e-4584-a3c0-0fe4c384e275 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:28.162" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.162" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1971gitlab # [ 242.987611] gitaly[894]: time="2026-10-02T14:13:58.259Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7017 command.oublock=0 command.real_time_ms=85 command.spawn_token_fork_ms=5 command.system_time_ms=45 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:28.162" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.162" grpc.time_ms=96.804 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 242.995239] gitaly[894]: time="2026-10-02T14:13:58.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDXANTFQAJBA5ZWW6QH3R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:28.267" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.267" grpc.time_ms=0.417 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 243.024950] gitaly[894]: time="2026-10-02T14:13:58.298Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDXANTFQAJBA5ZWW6QH3R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:08.272" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.292" grpc.time_ms=5.092 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 243.038388] gitaly[894]: time="2026-10-02T14:13:58.311Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:28.110" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.310" grpc.time_ms=0.6 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 243.054956] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 981976gitlab # [ 243.055773] nixbot[2626]: {"ts": "2026-10-02T14:13:58.328Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6c5a08f964a408d132ffd4a6650bac31eb24ad16 \"HTTP/1.1 201 Created\""}1977gitlab # [ 243.059831] gitaly[894]: time="2026-10-02T14:13:58.332Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:28.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.332" grpc.time_ms=0.446 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 243.065171] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.338Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"25cf467b487d78fd9ee03cf8","created_at":"2026-10-02T14:13:58.336Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"6cccf3282843be127a6b7275","job_size_bytes":3,"pid":2497,"job_status":"deduplicated","message":"PipelineProcessWorker JID-25cf467b487d78fd9ee03cf8: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1979gitlab # [ 243.066574] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.339Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6cccf3282843be127a6b7275","created_at":"2026-10-02T14:13:58.099Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-c00469e02a844b90","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.101Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-6cccf3282843be127a6b7275: rescheduled"}1980gitlab # [ 243.070868] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.343Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6cccf3282843be127a6b7275","created_at":"2026-10-02T14:13:58.099Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-c00469e02a844b90","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.101Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6cccf3282843be127a6b7275: done: 0.24131 sec","job_status":"done","queue_duration_s":0.00141,"scheduling_latency_s":0.001438,"gitaly_calls":3,"gitaly_duration_s":0.113661,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014055,"redis_read_bytes":226,"redis_write_bytes":18470,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000512,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000551,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003625,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12316,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004954,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000489,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000683,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002729,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08803,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.207409881,"duration_s":0.24131,"completed_at":"2026-10-02T14:13:58.343Z","load_balancing_strategy":"primary","db_duration_s":0.025596,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1981gitlab # [ 243.110401] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f92350fea448131dec3f7f79","created_at":"2026-10-02T14:13:58.155Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.158Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f92350fea448131dec3f7f79: start","job_status":"start","queue_duration_s":0.191182,"scheduling_latency_s":0.191199}1982gitlab # [ 243.150745] gitaly[894]: time="2026-10-02T14:13:58.414Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDXECSCHZYN2594XCY7S3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.406" grpc.time_ms=8.534 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1983gitlab # [ 243.151556] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 661984gitlab # [ 243.152055] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f92350fea448131dec3f7f79","created_at":"2026-10-02T14:13:58.155Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.158Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f92350fea448131dec3f7f79: done: 0.048384 sec","job_status":"done","queue_duration_s":0.191182,"scheduling_latency_s":0.191199,"redis_calls":7,"redis_duration_s":0.0073149999999999995,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048384,"completed_at":"2026-10-02T14:13:58.397Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015906,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1985gitlab # [ 243.198258] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.403Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"692eeded2ec6ba6eb03ffdfd","created_at":"2026-10-02T14:13:58.275Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.277Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-692eeded2ec6ba6eb03ffdfd: start","job_status":"start","queue_duration_s":0.125474,"scheduling_latency_s":0.125492}1986gitlab # [ 243.198971] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.423Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"692eeded2ec6ba6eb03ffdfd","created_at":"2026-10-02T14:13:58.275Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.277Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-692eeded2ec6ba6eb03ffdfd: done: 0.020241 sec","job_status":"done","queue_duration_s":0.125474,"scheduling_latency_s":0.125492,"redis_calls":7,"redis_duration_s":0.001124,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020241,"completed_at":"2026-10-02T14:13:58.423Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 243.240954] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.429Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"36ccaad1f82c4eeb5807094c","created_at":"2026-10-02T14:13:58.282Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.284Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-36ccaad1f82c4eeb5807094c: start","job_status":"start","queue_duration_s":0.144942,"scheduling_latency_s":0.144958}1988gitlab # [ 243.241674] gitlab-workhorse[821]: time="2026-10-02T14:13:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671989gitlab # [ 243.242726] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 401990gitlab # [ 243.280942] gitaly[894]: time="2026-10-02T14:13:58.455Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDXGGQ2ZKK75VPA0BHKP3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.449" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1991gitlab # [ 243.281904] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.448Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"36ccaad1f82c4eeb5807094c","created_at":"2026-10-02T14:13:58.282Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.284Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-36ccaad1f82c4eeb5807094c: done: 0.019346 sec","job_status":"done","queue_duration_s":0.144942,"scheduling_latency_s":0.144958,"redis_calls":7,"redis_duration_s":0.001715,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019346,"completed_at":"2026-10-02T14:13:58.448Z","load_balancing_strategy":"primary","db_duration_s":0.002657,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1992gitlab # [ 243.290282] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4e9ef674bbb89d99a514c883","created_at":"2026-10-02T14:13:58.290Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.292Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4e9ef674bbb89d99a514c883: start","job_status":"start","queue_duration_s":0.157356,"scheduling_latency_s":0.157371}1993gitlab # [ 243.304069] gitaly[894]: time="2026-10-02T14:13:58.456Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDXGGQ2ZKK75VPA0BHKP3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.449" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1994gitlab # [ 243.344276] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4e9ef674bbb89d99a514c883","created_at":"2026-10-02T14:13:58.290Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.292Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4e9ef674bbb89d99a514c883: done: 0.020536 sec","job_status":"done","queue_duration_s":0.157356,"scheduling_latency_s":0.157371,"redis_calls":10,"redis_duration_s":0.0016460000000000001,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000418,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020536,"completed_at":"2026-10-02T14:13:58.470Z","load_balancing_strategy":"primary","db_duration_s":0.005107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 243.389173] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2153c254e4701c8f1503baba","created_at":"2026-10-02T14:13:58.293Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.294Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2153c254e4701c8f1503baba: start","job_status":"start","queue_duration_s":0.176712,"scheduling_latency_s":0.176741}1996gitlab # [ 243.389869] gitaly[894]: time="2026-10-02T14:13:58.456Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDXGGQ2ZKK75VPA0BHKP3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.449" grpc.time_ms=6.668 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1997gitlab # [ 243.390733] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2153c254e4701c8f1503baba","created_at":"2026-10-02T14:13:58.293Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.294Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2153c254e4701c8f1503baba: done: 0.017605 sec","job_status":"done","queue_duration_s":0.176712,"scheduling_latency_s":0.176741,"redis_calls":7,"redis_duration_s":0.000951,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017605,"completed_at":"2026-10-02T14:13:58.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1998gitlab # [ 243.435275] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"94b33eefd9f00636e6e12ef3","created_at":"2026-10-02T14:13:58.294Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.297Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-94b33eefd9f00636e6e12ef3: start","job_status":"start","queue_duration_s":0.192655,"scheduling_latency_s":0.192669}1999gitlab # [ 243.435903] gitaly[894]: time="2026-10-02T14:13:58.631Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:58.630" grpc.time_ms=0.818 pid=894 span.kind=server system=grpc2000gitlab # [ 243.442858] gitaly[894]: time="2026-10-02T14:13:58.647Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:58.647" grpc.time_ms=0.352 pid=894 span.kind=server system=grpc2001gitlab # [ 243.486842] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.505Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"94b33eefd9f00636e6e12ef3","created_at":"2026-10-02T14:13:58.294Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.297Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-94b33eefd9f00636e6e12ef3: done: 0.015864 sec","job_status":"done","queue_duration_s":0.192655,"scheduling_latency_s":0.192669,"redis_calls":8,"redis_duration_s":0.0027960000000000003,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00254,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015864,"completed_at":"2026-10-02T14:13:58.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2002gitlab # [ 243.488510] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.506Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9369651c85fcbdde27ef092f","created_at":"2026-10-02T14:13:58.297Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.299Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9369651c85fcbdde27ef092f: start","job_status":"start","queue_duration_s":0.207012,"scheduling_latency_s":0.207025}2003gitlab # [ 243.504262] gitaly[894]: time="2026-10-02T14:13:58.663Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:58.663" grpc.time_ms=0.333 pid=894 span.kind=server system=grpc2004gitlab # [ 243.512645] gitaly[894]: time="2026-10-02T14:13:58.672Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW diskcache=0d4ba6fd-b29b-4557-b3be-282d96bc3e8f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:28.013" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.613" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 243.521576] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.523Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9369651c85fcbdde27ef092f","created_at":"2026-10-02T14:13:58.297Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.299Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9369651c85fcbdde27ef092f: done: 0.0171 sec","job_status":"done","queue_duration_s":0.207012,"scheduling_latency_s":0.207025,"redis_calls":7,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0171,"completed_at":"2026-10-02T14:13:58.523Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 243.585992] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.524Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"395ab1a795625cce5b3d2dab","created_at":"2026-10-02T14:13:58.299Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.300Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-395ab1a795625cce5b3d2dab: start","job_status":"start","queue_duration_s":0.224126,"scheduling_latency_s":0.22414}2007gitlab # [ 243.586729] gitaly[894]: time="2026-10-02T14:13:58.672Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=57 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6940 command.oublock=0 command.real_time_ms=52 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:28.013" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:58.613" grpc.time_ms=58.555 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2008gitlab # [ 243.587479] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.540Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"395ab1a795625cce5b3d2dab","created_at":"2026-10-02T14:13:58.299Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.300Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-395ab1a795625cce5b3d2dab: done: 0.015387 sec","job_status":"done","queue_duration_s":0.224126,"scheduling_latency_s":0.22414,"redis_calls":7,"redis_duration_s":0.000938,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015387,"completed_at":"2026-10-02T14:13:58.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 243.629196] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d559a64da1d8cd3e6b54de20","created_at":"2026-10-02T14:13:58.301Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.302Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d559a64da1d8cd3e6b54de20: start","job_status":"start","queue_duration_s":0.239149,"scheduling_latency_s":0.239162}2010gitlab # [ 243.636782] gitaly[894]: time="2026-10-02T14:13:58.704Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:28.103" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.703" grpc.time_ms=0.66 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 243.648176] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d559a64da1d8cd3e6b54de20","created_at":"2026-10-02T14:13:58.301Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.302Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d559a64da1d8cd3e6b54de20: done: 0.008069 sec","job_status":"done","queue_duration_s":0.239149,"scheduling_latency_s":0.239162,"redis_calls":7,"redis_duration_s":0.000872,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008069,"completed_at":"2026-10-02T14:13:58.549Z","load_balancing_strategy":"primary","db_duration_s":0.000261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2012gitlab # [ 243.699120] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f9b0e910cf0ac9e63e199be6","created_at":"2026-10-02T14:13:58.302Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.303Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f9b0e910cf0ac9e63e199be6: start","job_status":"start","queue_duration_s":0.246874,"scheduling_latency_s":0.246886}2013gitlab # [ 243.699836] gitaly[894]: time="2026-10-02T14:13:58.725Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX23BRXJZXHQ51VDYHDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:28.124" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:58.725" grpc.time_ms=0.42 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 243.745850] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f9b0e910cf0ac9e63e199be6","created_at":"2026-10-02T14:13:58.302Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.303Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f9b0e910cf0ac9e63e199be6: done: 0.019707 sec","job_status":"done","queue_duration_s":0.246874,"scheduling_latency_s":0.246886,"redis_calls":7,"redis_duration_s":0.004377,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019707,"completed_at":"2026-10-02T14:13:58.569Z","load_balancing_strategy":"primary","db_duration_s":0.00506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2015gitlab # [ 243.746936] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.572Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fcdb0f968afb190d4eda993b","created_at":"2026-10-02T14:13:58.339Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.340Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fcdb0f968afb190d4eda993b: start","job_status":"start","queue_duration_s":0.231777,"scheduling_latency_s":0.231791}2016gitlab # [ 243.790377] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fcdb0f968afb190d4eda993b","created_at":"2026-10-02T14:13:58.339Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-0ee7e6a7bb0c4dfa","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.340Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fcdb0f968afb190d4eda993b: done: 0.160151 sec","job_status":"done","queue_duration_s":0.231777,"scheduling_latency_s":0.231791,"gitaly_calls":3,"gitaly_duration_s":0.064574,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008829,"redis_read_bytes":141,"redis_write_bytes":16717,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000286,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000544,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001734,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11223,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.003633,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000138,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000601,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001607,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071457,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13893777,"duration_s":0.160151,"completed_at":"2026-10-02T14:13:58.732Z","load_balancing_strategy":"primary","db_duration_s":0.019242,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'2018gitlab # [ 243.830673] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6d9dda014afdaf2aa33f0919","created_at":"2026-10-02T14:13:58.608Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.610Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6d9dda014afdaf2aa33f0919: start","job_status":"start","queue_duration_s":0.123553,"scheduling_latency_s":0.123567}2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.04 seconds)2020gitlab # [ 243.831568] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.756Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6d9dda014afdaf2aa33f0919","created_at":"2026-10-02T14:13:58.608Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.610Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6d9dda014afdaf2aa33f0919: done: 0.023048 sec","job_status":"done","queue_duration_s":0.123553,"scheduling_latency_s":0.123567,"redis_calls":7,"redis_duration_s":0.00093,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023048,"completed_at":"2026-10-02T14:13:58.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2021gitlab # [ 243.876594] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.757Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9481f4925b319bceadbcf975","created_at":"2026-10-02T14:13:58.676Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.677Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9481f4925b319bceadbcf975: start","job_status":"start","queue_duration_s":0.079565,"scheduling_latency_s":0.079579}2022gitlab # [ 243.877485] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.779Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9481f4925b319bceadbcf975","created_at":"2026-10-02T14:13:58.676Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.677Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9481f4925b319bceadbcf975: done: 0.022236 sec","job_status":"done","queue_duration_s":0.079565,"scheduling_latency_s":0.079579,"redis_calls":7,"redis_duration_s":0.00794,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022236,"completed_at":"2026-10-02T14:13:58.779Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 243.927658] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.782Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a80f231aedaea8eba9b3d29a","created_at":"2026-10-02T14:13:58.681Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.683Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a80f231aedaea8eba9b3d29a: start","job_status":"start","queue_duration_s":0.09881,"scheduling_latency_s":0.098825}2024gitlab # [ 243.928526] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a80f231aedaea8eba9b3d29a","created_at":"2026-10-02T14:13:58.681Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.683Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a80f231aedaea8eba9b3d29a: done: 0.020291 sec","job_status":"done","queue_duration_s":0.09881,"scheduling_latency_s":0.098825,"redis_calls":7,"redis_duration_s":0.004428,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020291,"completed_at":"2026-10-02T14:13:58.802Z","load_balancing_strategy":"primary","db_duration_s":0.00257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 243.976168] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.805Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d841136c9f9ceac0efb99fb9","created_at":"2026-10-02T14:13:58.688Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.689Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d841136c9f9ceac0efb99fb9: start","job_status":"start","queue_duration_s":0.116074,"scheduling_latency_s":0.116089}2026gitlab # [ 243.977212] nixbot[2626]: INFO: ::ffff:127.0.0.1:54708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK2027gitlab # [ 243.977643] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d841136c9f9ceac0efb99fb9","created_at":"2026-10-02T14:13:58.688Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.689Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d841136c9f9ceac0efb99fb9: done: 0.022921 sec","job_status":"done","queue_duration_s":0.116074,"scheduling_latency_s":0.116089,"redis_calls":10,"redis_duration_s":0.00359,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022921,"completed_at":"2026-10-02T14:13:58.828Z","load_balancing_strategy":"primary","db_duration_s":0.002929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2028gitlab # [ 244.017671] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f728c1d767b5976d985b4a00","created_at":"2026-10-02T14:13:58.689Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.690Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f728c1d767b5976d985b4a00: start","job_status":"start","queue_duration_s":0.138674,"scheduling_latency_s":0.138689}2029gitlab # [ 244.023732] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.843Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f728c1d767b5976d985b4a00","created_at":"2026-10-02T14:13:58.689Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.690Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f728c1d767b5976d985b4a00: done: 0.014221 sec","job_status":"done","queue_duration_s":0.138674,"scheduling_latency_s":0.138689,"redis_calls":7,"redis_duration_s":0.000909,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014221,"completed_at":"2026-10-02T14:13:58.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2030gitlab # [ 244.062026] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d68f6297ddf03d7894763c44","created_at":"2026-10-02T14:13:58.690Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.692Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d68f6297ddf03d7894763c44: start","job_status":"start","queue_duration_s":0.152139,"scheduling_latency_s":0.152153}2031gitlab # [ 244.102914] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.857Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d68f6297ddf03d7894763c44","created_at":"2026-10-02T14:13:58.690Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.692Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d68f6297ddf03d7894763c44: done: 0.013258 sec","job_status":"done","queue_duration_s":0.152139,"scheduling_latency_s":0.152153,"redis_calls":8,"redis_duration_s":0.001003,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00022,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013258,"completed_at":"2026-10-02T14:13:58.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2032gitlab # [ 244.112721] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.858Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"23ebb89cc3c651bfcc26dac9","created_at":"2026-10-02T14:13:58.692Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.693Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-23ebb89cc3c651bfcc26dac9: start","job_status":"start","queue_duration_s":0.164705,"scheduling_latency_s":0.164718}2033gitlab # [ 244.128849] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.874Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"23ebb89cc3c651bfcc26dac9","created_at":"2026-10-02T14:13:58.692Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.693Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-23ebb89cc3c651bfcc26dac9: done: 0.015758 sec","job_status":"done","queue_duration_s":0.164705,"scheduling_latency_s":0.164718,"redis_calls":7,"redis_duration_s":0.0011519999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015758,"completed_at":"2026-10-02T14:13:58.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2034gitlab # [ 244.192087] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.875Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a7392683b90fe1232edf17b4","created_at":"2026-10-02T14:13:58.693Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.694Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a7392683b90fe1232edf17b4: start","job_status":"start","queue_duration_s":0.18016,"scheduling_latency_s":0.180173}2035gitlab # [ 244.192714] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.889Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a7392683b90fe1232edf17b4","created_at":"2026-10-02T14:13:58.693Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.694Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a7392683b90fe1232edf17b4: done: 0.014945 sec","job_status":"done","queue_duration_s":0.18016,"scheduling_latency_s":0.180173,"redis_calls":7,"redis_duration_s":0.0008600000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014945,"completed_at":"2026-10-02T14:13:58.889Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2036gitlab # [ 244.232910] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"79f2f0e85c8529086843b9cf","created_at":"2026-10-02T14:13:58.695Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.695Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-79f2f0e85c8529086843b9cf: start","job_status":"start","queue_duration_s":0.194834,"scheduling_latency_s":0.194848}2037gitlab # [ 244.233741] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"79f2f0e85c8529086843b9cf","created_at":"2026-10-02T14:13:58.695Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.695Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-79f2f0e85c8529086843b9cf: done: 0.008093 sec","job_status":"done","queue_duration_s":0.194834,"scheduling_latency_s":0.194848,"redis_calls":7,"redis_duration_s":0.000888,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008093,"completed_at":"2026-10-02T14:13:58.898Z","load_balancing_strategy":"primary","db_duration_s":0.000255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2038gitlab # [ 244.302706] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.899Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cc7fdd97e3429ff8a799ada1","created_at":"2026-10-02T14:13:58.696Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.697Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cc7fdd97e3429ff8a799ada1: start","job_status":"start","queue_duration_s":0.202658,"scheduling_latency_s":0.20267}2039gitlab # [ 244.303593] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:13:58.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cc7fdd97e3429ff8a799ada1","created_at":"2026-10-02T14:13:58.696Z","trace_propagation_headers":{"sentry-trace":"67a7cbf7c4014a2fab94d5600178f047-2397f224829a4e8f","baggage":"sentry-trace_id=67a7cbf7c4014a2fab94d5600178f047,sentry-release=Unknown"},"correlation_id":"01M3YFDX23BRXJZXHQ51VDYHDW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T14:13:58.697Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cc7fdd97e3429ff8a799ada1: done: 0.020031 sec","job_status":"done","queue_duration_s":0.202658,"scheduling_latency_s":0.20267,"redis_calls":7,"redis_duration_s":0.007588,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020031,"completed_at":"2026-10-02T14:13:58.919Z","load_balancing_strategy":"primary","db_duration_s":0.001821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2040gitlab # [ 244.360993] gitaly[894]: time="2026-10-02T14:13:59.633Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1176 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDX99F7E2DYF4PQQFCK5A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:13:58.239" grpc.time_ms=1393.95 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # [ 244.375268] gitlab-workhorse[821]: time="2026-10-02T14:13:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162042gitlab # [ 244.376310] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:13:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 14582043gitlab # [ 244.476089] gitaly[894]: time="2026-10-02T14:13:59.749Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:29.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:13:59.747" grpc.time_ms=0.886 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 244.528540] gitaly[894]: time="2026-10-02T14:13:59.801Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-02T14:14:29.089" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:59.789" grpc.time_ms=11.457 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab # [ 244.548052] gitaly[894]: time="2026-10-02T14:13:59.820Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:09.109" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:59.810" grpc.time_ms=10.804 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046gitlab # [ 244.613530] gitaly[894]: time="2026-10-02T14:13:59.886Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T14:14:09.035" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.885" grpc.time_ms=0.423 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 244.629851] gitaly[894]: time="2026-10-02T14:13:59.902Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T14:14:09.042" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:13:59.892" grpc.time_ms=10.164 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 244.682444] gitaly[894]: time="2026-10-02T14:13:59.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:59.954" grpc.time_ms=0.941 pid=894 span.kind=server system=grpc2049gitlab # [ 244.722926] gitaly[894]: time="2026-10-02T14:13:59.995Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:13:59.995" grpc.time_ms=0.458 pid=894 span.kind=server system=grpc2050gitlab # [ 244.735482] gitaly[894]: time="2026-10-02T14:14:00.008Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:09.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.906" operations="[repack_refs]" pid=894 ref=refs/keep-around/7a63720443839b5c83b2fd9499e06757fa274d8e remote_ip="2001:db8:1::1" revision=7a63720443839b5c83b2fd9499e06757fa274d8e span.kind=server system=grpc username=root2051gitlab # [ 244.742155] gitaly[894]: time="2026-10-02T14:14:00.015Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z diskcache=eb540edb-ec8c-4e71-9918-37ecd245d4b7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:09.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.906" pid=894 ref=refs/keep-around/7a63720443839b5c83b2fd9499e06757fa274d8e remote_ip="2001:db8:1::1" revision=7a63720443839b5c83b2fd9499e06757fa274d8e span.kind=server system=grpc username=root2052gitlab # [ 244.742949] gitaly[894]: time="2026-10-02T14:14:00.015Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=93 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5505 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:09.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.906" grpc.time_ms=108.499 pid=894 ref=refs/keep-around/7a63720443839b5c83b2fd9499e06757fa274d8e remote_ip="2001:db8:1::1" revision=7a63720443839b5c83b2fd9499e06757fa274d8e span.kind=server system=grpc username=root2053gitlab # [ 244.747862] gitaly[894]: time="2026-10-02T14:14:00.020Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:30.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:00.020" grpc.time_ms=0.58 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 244.769663] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.041Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3599a6eee89f47079f14e521","created_at":"2026-10-02T14:14:00.036Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-40ec12282ebe487a","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.039Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3599a6eee89f47079f14e521: start","job_status":"start","queue_duration_s":0.00194,"scheduling_latency_s":0.001992}2055gitlab # [ 244.796483] gitaly[894]: time="2026-10-02T14:14:00.069Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:09.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.906" pid=894 ref=refs/keep-around/7a63720443839b5c83b2fd9499e06757fa274d8e remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-02 14:13:02.205028691 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=7a63720443839b5c83b2fd9499e06757fa274d8e span.kind=server system=grpc username=root2056gitlab # [ 244.809864] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.082Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3599a6eee89f47079f14e521","created_at":"2026-10-02T14:14:00.036Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-40ec12282ebe487a","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.039Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3599a6eee89f47079f14e521: done: 0.041044 sec","job_status":"done","queue_duration_s":0.00194,"scheduling_latency_s":0.001992,"redis_calls":7,"redis_duration_s":0.002177,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041044,"completed_at":"2026-10-02T14:14:00.082Z","load_balancing_strategy":"primary","db_duration_s":0.006325,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2057gitlab # [ 244.815450] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.088Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3130798c199afbfe2b121aa5","created_at":"2026-10-02T14:14:00.040Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-40ec12282ebe487a","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.042Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3130798c199afbfe2b121aa5: start","job_status":"start","queue_duration_s":0.045997,"scheduling_latency_s":0.046044}2058gitlab # [ 244.857841] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4402059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e'2060gitlab # [ 244.858599] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.130Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3130798c199afbfe2b121aa5","created_at":"2026-10-02T14:14:00.040Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-40ec12282ebe487a","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.042Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3130798c199afbfe2b121aa5: done: 0.042489 sec","job_status":"done","queue_duration_s":0.045997,"scheduling_latency_s":0.046044,"redis_calls":10,"redis_duration_s":0.001866,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042489,"completed_at":"2026-10-02T14:14:00.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 244.865183] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.136Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0f21fcae29ae6afe32d5eed2","created_at":"2026-10-02T14:14:00.109Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-40ec12282ebe487a","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.112Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0f21fcae29ae6afe32d5eed2: start","job_status":"start","queue_duration_s":0.024506,"scheduling_latency_s":0.024523}2062gitlab # [ 244.879294] nixbot[2626]: {"ts": "2026-10-02T14:14:00.131Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e \"HTTP/1.1 201 Created\""}2063gitlab # [ 244.881668] nixbot[2626]: {"ts": "2026-10-02T14:14:00.141Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-7a6372044383-4"}2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e', in 0.04 seconds)2065(finished: subtest: push delivers the webhook, in 46.65 seconds)2066subtest: eval and build post commit statuses2067gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses2068gitlab # [ 244.919397] gitaly[894]: time="2026-10-02T14:14:00.192Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:30.191" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:00.191" grpc.time_ms=0.532 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 244.921591] nixbot[2626]: INFO: ::ffff:127.0.0.1:54718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 200 OK2070gitlab # [ 244.945599] gitaly[894]: time="2026-10-02T14:14:00.218Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:09.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.906" pid=894 ref=refs/keep-around/7a63720443839b5c83b2fd9499e06757fa274d8e remote_ip="2001:db8:1::1" revision=7a63720443839b5c83b2fd9499e06757fa274d8e span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2071gitlab # [ 244.946201] gitaly[894]: time="2026-10-02T14:14:00.218Z" level=info msg="optimized repository" clean_stale_data_time=136.437732ms clean_work_trees_time="69.562µs" commit_graph_time="3.632µs" correlation_id=01M3YFDYRAFRPPCPDA90NB711Z gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=894 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.19µs" storage_name=default system=housekeeping total_time=136.614011ms2072gitlab # [ 244.946765] gitaly[894]: time="2026-10-02T14:14:00.218Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T14:14:09.056" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T14:13:59.906" pid=894 ref=refs/keep-around/7a63720443839b5c83b2fd9499e06757fa274d8e remote_ip="2001:db8:1::1" revision=7a63720443839b5c83b2fd9499e06757fa274d8e span.kind=server system=grpc username=root2073gitlab # [ 244.949865] gitaly[894]: time="2026-10-02T14:14:00.222Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDYRAFRPPCPDA90NB711Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:30.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:00.222" grpc.time_ms=0.513 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses, in 0.10 seconds)2075gitlab # [ 244.963480] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.236Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0f21fcae29ae6afe32d5eed2","created_at":"2026-10-02T14:14:00.109Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-40ec12282ebe487a","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.112Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0f21fcae29ae6afe32d5eed2: done: 0.099785 sec","job_status":"done","queue_duration_s":0.024506,"scheduling_latency_s":0.024523,"gitaly_calls":2,"gitaly_duration_s":0.006014,"redis_calls":35,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00944,"redis_read_bytes":80,"redis_write_bytes":5206,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001166,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002176,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000194,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001922,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001402,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000378,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061456,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.072104694,"duration_s":0.099785,"completed_at":"2026-10-02T14:14:00.236Z","load_balancing_strategy":"primary","db_duration_s":0.021205,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2076gitlab # [ 244.993187] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.241Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"39b29359c036ee16c267125d","created_at":"2026-10-02T14:14:00.179Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-ab23ce6bc7444f87","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.181Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-39b29359c036ee16c267125d: start","job_status":"start","queue_duration_s":0.059531,"scheduling_latency_s":0.059548}2077gitlab # [ 245.004828] gitaly[894]: time="2026-10-02T14:14:00.263Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFDZ8ZZWKM8H6BQP5FS42T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:30.261" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:00.261" grpc.time_ms=2.087 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 245.015937] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:00.284Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"39b29359c036ee16c267125d","created_at":"2026-10-02T14:14:00.179Z","trace_propagation_headers":{"sentry-trace":"36e5519e68bf49838bd65f9ec616f48e-ab23ce6bc7444f87","baggage":"sentry-trace_id=36e5519e68bf49838bd65f9ec616f48e,sentry-release=Unknown"},"correlation_id":"01M3YFDYRAFRPPCPDA90NB711Z","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:00.181Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-39b29359c036ee16c267125d: done: 0.042802 sec","job_status":"done","queue_duration_s":0.059531,"scheduling_latency_s":0.059548,"redis_calls":7,"redis_duration_s":0.017986000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042802,"completed_at":"2026-10-02T14:14:00.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 245.060173] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 642080gitlab # [ 245.103209] nixbot[2626]: {"ts": "2026-10-02T14:14:00.373Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-7a6372044383-4", "argv0": "bwrap"}2081gitlab # [ 245.182323] nix-daemon[2786]: accepted connection from pid 3621, user nixbot2082gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses2083gitlab # [ 246.118137] gitaly[894]: time="2026-10-02T14:14:01.390Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE0BRHYCVWZPMNBP92MB2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:31.388" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:01.389" grpc.time_ms=0.855 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 246.139414] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 712085gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses, in 0.12 seconds)2086gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses2087gitlab # [ 247.274307] gitaly[894]: time="2026-10-02T14:14:02.546Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE1ESNJ4G47YT8HBJ18T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:32.545" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:02.545" grpc.time_ms=0.866 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 247.308511] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1222089gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses, in 0.16 seconds)2090gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses2091gitlab # [ 248.408761] gitaly[894]: time="2026-10-02T14:14:03.681Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE2K62NST1EGW4PGJ9YX2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:33.679" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:03.679" grpc.time_ms=0.904 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 248.433503] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 832093gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses, in 0.13 seconds)2094gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses2095gitlab # [ 249.535617] gitaly[894]: time="2026-10-02T14:14:04.808Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE3PDYYZQ5KK7BF44QTAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:34.806" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:04.806" grpc.time_ms=0.881 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 249.584695] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1072097gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses, in 0.15 seconds)2098gitlab # [ 249.896281] nix-daemon[2786]: accepted connection from pid 3656, user nixbot2099gitlab # [ 249.908089] nix-daemon[2786]: accepted connection from pid 3621, user nixbot2100gitlab # [ 250.011745] gitaly[894]: time="2026-10-02T14:14:05.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:35.283" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:05.283" grpc.time_ms=0.873 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 250.067930] gitaly[894]: time="2026-10-02T14:14:05.340Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:15.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:14:05.329" grpc.time_ms=11.216 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 250.116526] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.388Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"619fa6b5f3381cb573097e78","created_at":"2026-10-02T14:14:05.381Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-b35e9b22b03a4b0c","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.385Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-619fa6b5f3381cb573097e78: start","job_status":"start","queue_duration_s":0.002036,"scheduling_latency_s":0.002082}2103gitlab # [ 250.129922] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1832104gitlab # [ 250.134612] nixbot[2626]: {"ts": "2026-10-02T14:14:05.407Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e \"HTTP/1.1 201 Created\""}2105gitlab # [ 250.189777] gitaly[894]: time="2026-10-02T14:14:05.462Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE4B4H3G45VDHT3JP5DHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:35.461" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:05.461" grpc.time_ms=0.773 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 250.223932] gitaly[894]: time="2026-10-02T14:14:05.497Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YFE4B4H3G45VDHT3JP5DHB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:15.170" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:14:05.491" grpc.time_ms=5.646 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 250.241799] gitaly[894]: time="2026-10-02T14:14:05.514Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:14:05.514" grpc.time_ms=0.219 pid=894 span.kind=server system=grpc2108gitlab # [ 250.258980] gitaly[894]: time="2026-10-02T14:14:05.532Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:14:05.531" grpc.time_ms=0.298 pid=894 span.kind=server system=grpc2109gitlab # [ 250.285066] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1452110gitlab # [ 250.287457] gitaly[894]: time="2026-10-02T14:14:05.560Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:14:05.560" grpc.time_ms=0.365 pid=894 span.kind=server system=grpc2111gitlab # [ 250.296748] nixbot[2626]: {"ts": "2026-10-02T14:14:05.569Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e \"HTTP/1.1 201 Created\""}2112gitlab # [ 250.304866] gitaly[894]: time="2026-10-02T14:14:05.577Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH diskcache=0f9d37ea-9c08-43f4-97e2-ac47c0a5719b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:35.296" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:14:05.496" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 250.305625] gitaly[894]: time="2026-10-02T14:14:05.578Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7200 command.oublock=0 command.real_time_ms=72 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T14:14:35.296" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:14:05.496" grpc.time_ms=81.154 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 250.345881] gitaly[894]: time="2026-10-02T14:14:05.618Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T14:14:35.018" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:05.618" grpc.time_ms=0.555 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 250.346730] gitaly[894]: time="2026-10-02T14:14:05.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE4GEBGQXX1G16HW536YY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:35.618" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:05.618" grpc.time_ms=0.37 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 250.370126] gitaly[894]: time="2026-10-02T14:14:05.643Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:35.042" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:05.642" grpc.time_ms=0.336 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 250.381426] gitaly[894]: time="2026-10-02T14:14:05.643Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFE4GEBGQXX1G16HW536YY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T14:14:15.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T14:14:05.638" grpc.time_ms=4.877 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 250.382063] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a9fad5abb4c20a331ff113bf","created_at":"2026-10-02T14:14:05.648Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"619fa6b5f3381cb573097e78","job_size_bytes":3,"pid":2497,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a9fad5abb4c20a331ff113bf: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2119gitlab # [ 250.382715] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.650Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"619fa6b5f3381cb573097e78","created_at":"2026-10-02T14:14:05.381Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-b35e9b22b03a4b0c","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.385Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-619fa6b5f3381cb573097e78: rescheduled"}2120gitlab # [ 250.383506] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.655Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"619fa6b5f3381cb573097e78","created_at":"2026-10-02T14:14:05.381Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-b35e9b22b03a4b0c","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.385Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-619fa6b5f3381cb573097e78: done: 0.267243 sec","job_status":"done","queue_duration_s":0.002036,"scheduling_latency_s":0.002082,"gitaly_calls":3,"gitaly_duration_s":0.090233,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012045,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001033,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000876,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002615,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004411,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000295,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000317,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001465,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115884,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.221327013,"duration_s":0.267243,"completed_at":"2026-10-02T14:14:05.655Z","load_balancing_strategy":"primary","db_duration_s":0.05369,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2121gitlab # [ 250.467150] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.739Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"efd8b76b0db130230f684059","created_at":"2026-10-02T14:14:05.490Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.492Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-efd8b76b0db130230f684059: start","job_status":"start","queue_duration_s":0.24704,"scheduling_latency_s":0.247068}2122gitlab # [ 250.487214] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1772123gitlab # [ 250.490176] nixbot[2626]: {"ts": "2026-10-02T14:14:05.761Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7a63720443839b5c83b2fd9499e06757fa274d8e \"HTTP/1.1 201 Created\""}2124gitlab # [ 250.500690] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"efd8b76b0db130230f684059","created_at":"2026-10-02T14:14:05.490Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.492Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-efd8b76b0db130230f684059: done: 0.033788 sec","job_status":"done","queue_duration_s":0.24704,"scheduling_latency_s":0.247068,"redis_calls":7,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033788,"completed_at":"2026-10-02T14:14:05.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008999,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2125gitlab # [ 250.541650] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.814Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbf886455a795982acbaae8d","created_at":"2026-10-02T14:14:05.582Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.583Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbf886455a795982acbaae8d: start","job_status":"start","queue_duration_s":0.230125,"scheduling_latency_s":0.230174}2126gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses2127gitlab # [ 250.582835] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.855Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbf886455a795982acbaae8d","created_at":"2026-10-02T14:14:05.582Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.583Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbf886455a795982acbaae8d: done: 0.041589 sec","job_status":"done","queue_duration_s":0.230125,"scheduling_latency_s":0.230174,"redis_calls":7,"redis_duration_s":0.002414,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041589,"completed_at":"2026-10-02T14:14:05.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2128gitlab # [ 250.623588] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"be58ab090d6d946c50600038","created_at":"2026-10-02T14:14:05.588Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.590Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-be58ab090d6d946c50600038: start","job_status":"start","queue_duration_s":0.305555,"scheduling_latency_s":0.30558}2129gitlab # [ 250.667082] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.939Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"be58ab090d6d946c50600038","created_at":"2026-10-02T14:14:05.588Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.590Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-be58ab090d6d946c50600038: done: 0.043048 sec","job_status":"done","queue_duration_s":0.305555,"scheduling_latency_s":0.30558,"redis_calls":7,"redis_duration_s":0.001984,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043048,"completed_at":"2026-10-02T14:14:05.939Z","load_balancing_strategy":"primary","db_duration_s":0.008225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2130gitlab # [ 250.705471] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:05.978Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"696ab003cfb83f9777a801f2","created_at":"2026-10-02T14:14:05.596Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.597Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-696ab003cfb83f9777a801f2: start","job_status":"start","queue_duration_s":0.380918,"scheduling_latency_s":0.380944}2131gitlab # [ 250.719946] gitaly[894]: time="2026-10-02T14:14:05.992Z" level=info msg="finished unary call with code OK" catfile.duration_ms=11 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=11 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YFE4TW1DG07G12SPAXX76Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T14:14:35.280" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T14:14:05.980" grpc.time_ms=11.96 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 250.728718] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.001Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"696ab003cfb83f9777a801f2","created_at":"2026-10-02T14:14:05.596Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.597Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-696ab003cfb83f9777a801f2: done: 0.023182 sec","job_status":"done","queue_duration_s":0.380918,"scheduling_latency_s":0.380944,"redis_calls":10,"redis_duration_s":0.003381,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002268,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023182,"completed_at":"2026-10-02T14:14:06.001Z","load_balancing_strategy":"primary","db_duration_s":0.003052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 250.731350] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.004Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4fafd10313c7a50c1af9d763","created_at":"2026-10-02T14:14:05.597Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.598Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4fafd10313c7a50c1af9d763: start","job_status":"start","queue_duration_s":0.405717,"scheduling_latency_s":0.405732}2134gitlab # [ 250.753932] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.026Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4fafd10313c7a50c1af9d763","created_at":"2026-10-02T14:14:05.597Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.598Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4fafd10313c7a50c1af9d763: done: 0.022456 sec","job_status":"done","queue_duration_s":0.405717,"scheduling_latency_s":0.405732,"redis_calls":7,"redis_duration_s":0.001236,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022456,"completed_at":"2026-10-02T14:14:06.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 250.801186] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.027Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6f6666213f073521571bedc5","created_at":"2026-10-02T14:14:05.599Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.600Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6f6666213f073521571bedc5: start","job_status":"start","queue_duration_s":0.4272,"scheduling_latency_s":0.427214}2136gitlab # [ 250.801826] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6f6666213f073521571bedc5","created_at":"2026-10-02T14:14:05.599Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.600Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6f6666213f073521571bedc5: done: 0.014816 sec","job_status":"done","queue_duration_s":0.4272,"scheduling_latency_s":0.427214,"redis_calls":8,"redis_duration_s":0.001006,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014816,"completed_at":"2026-10-02T14:14:06.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 250.858552] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.043Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"519303eca8d500608c22c8d7","created_at":"2026-10-02T14:14:05.601Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.602Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-519303eca8d500608c22c8d7: start","job_status":"start","queue_duration_s":0.441208,"scheduling_latency_s":0.441223}2138gitlab # [ 250.859228] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.056Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"519303eca8d500608c22c8d7","created_at":"2026-10-02T14:14:05.601Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.602Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-519303eca8d500608c22c8d7: done: 0.013401 sec","job_status":"done","queue_duration_s":0.441208,"scheduling_latency_s":0.441223,"redis_calls":7,"redis_duration_s":0.000877,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013401,"completed_at":"2026-10-02T14:14:06.056Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 250.904685] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.057Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"6e128c919ee77efba0e99da3","created_at":"2026-10-02T14:14:05.602Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.603Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6e128c919ee77efba0e99da3: start","job_status":"start","queue_duration_s":0.454026,"scheduling_latency_s":0.454039}2140gitlab # [ 250.905543] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.077Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"6e128c919ee77efba0e99da3","created_at":"2026-10-02T14:14:05.602Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.603Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6e128c919ee77efba0e99da3: done: 0.019356 sec","job_status":"done","queue_duration_s":0.454026,"scheduling_latency_s":0.454039,"redis_calls":7,"redis_duration_s":0.000987,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019356,"completed_at":"2026-10-02T14:14:06.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 250.943800] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.078Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"9ad608db5ce37d5acbbdf2f9","created_at":"2026-10-02T14:14:05.606Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.607Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9ad608db5ce37d5acbbdf2f9: start","job_status":"start","queue_duration_s":0.470333,"scheduling_latency_s":0.470392}2142gitlab # [ 250.987929] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.097Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"9ad608db5ce37d5acbbdf2f9","created_at":"2026-10-02T14:14:05.606Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.607Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9ad608db5ce37d5acbbdf2f9: done: 0.019003 sec","job_status":"done","queue_duration_s":0.470333,"scheduling_latency_s":0.470392,"redis_calls":7,"redis_duration_s":0.002543,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019003,"completed_at":"2026-10-02T14:14:06.096Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 250.989619] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"552a2838b64aa42db214780e","created_at":"2026-10-02T14:14:05.607Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.608Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-552a2838b64aa42db214780e: start","job_status":"start","queue_duration_s":0.488941,"scheduling_latency_s":0.488954}2144gitlab # [ 251.032744] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"552a2838b64aa42db214780e","created_at":"2026-10-02T14:14:05.607Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.608Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-552a2838b64aa42db214780e: done: 0.008289 sec","job_status":"done","queue_duration_s":0.488941,"scheduling_latency_s":0.488954,"redis_calls":7,"redis_duration_s":0.000831,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008289,"completed_at":"2026-10-02T14:14:06.106Z","load_balancing_strategy":"primary","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2145gitlab # [ 251.071604] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.107Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"5bb2dc1599952738c55c845d","created_at":"2026-10-02T14:14:05.609Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.610Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5bb2dc1599952738c55c845d: start","job_status":"start","queue_duration_s":0.496957,"scheduling_latency_s":0.49697}2146gitlab # [ 251.072534] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"5bb2dc1599952738c55c845d","created_at":"2026-10-02T14:14:05.609Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.610Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5bb2dc1599952738c55c845d: done: 0.013123 sec","job_status":"done","queue_duration_s":0.496957,"scheduling_latency_s":0.49697,"redis_calls":7,"redis_duration_s":0.000853,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013123,"completed_at":"2026-10-02T14:14:06.120Z","load_balancing_strategy":"primary","db_duration_s":0.001802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2147gitlab # [ 251.089667] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-10-02T14:14:06.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"88341568b44bccabc2ce2c2f","created_at":"2026-10-02T14:14:05.651Z","trace_propagation_headers":{"sentry-trace":"b0aafc8a3c6a4057a73647f9b5ff0fd0-3180015f8da14bb0","baggage":"sentry-trace_id=b0aafc8a3c6a4057a73647f9b5ff0fd0,sentry-release=Unknown"},"correlation_id":"01M3YFE453MX6XS4SF5STES9KH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T14:14:05.651Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m7x1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-88341568b44bccabc2ce2c2f: start","job_status":"start","queue_duration_s":0.469078,"scheduling_latency_s":0.469091}2148gitlab # [ 251.151563] gitaly[894]: time="2026-10-02T14:14:06.424Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:14:06.424" grpc.time_ms=0.349 pid=894 span.kind=server system=grpc2149gitlab # [ 251.158422] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 5142150gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/7a63720443839b5c83b2fd9499e06757fa274d8e/statuses, in 0.58 seconds)2151(finished: subtest: eval and build post commit statuses, in 6.25 seconds)2152(finished: run the VM test script, in 314.60 seconds)2153gitlab # [ 251.180603] gitaly[894]: time="2026-10-02T14:14:06.453Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:14:06.453" grpc.time_ms=0.552 pid=894 span.kind=server system=grpc2154gitlab # [ 251.200196] gitaly[894]: time="2026-10-02T14:14:06.473Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YFE4XJAPJC014YPM6STTKA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T14:14:06.467" grpc.time_ms=5.486 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2155gitlab # [ 251.201112] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/10/02:14:14:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 4712156gitlab # [ 251.203936] gitaly[894]: time="2026-10-02T14:14:06.477Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YFE453MX6XS4SF5STES9KH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T14:14:06.476" grpc.time_ms=0.285 pid=894 span.kind=server system=grpc2157test script finished in 314.65s2158cleanup2159kill QemuMachine (pid 46)2160gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2161(finished: cleanup, in 1.52 seconds)2162additionally exposed symbols:2163 gitlab,2164 vlan1,2165 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2166[]2167[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-02T14:13:12.617Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2168[]2169[]2170[]2171[]2172[]2173[]2174[]2175[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-02T14:13:59.682418Z', 'started_at': '2026-10-02T14:14:00.136706Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2176[{'id': 5, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T14:14:00.103Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2177[{'id': 5, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T14:14:00.103Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2178[{'id': 5, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T14:14:00.103Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2179[{'id': 5, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T14:14:00.103Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2180[{'id': 5, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T14:14:00.103Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2181[{'id': 5, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-02T14:14:00.103Z', 'started_at': None, 'finished_at': '2026-10-02T14:14:05.370Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '7a63720443839b5c83b2fd9499e06757fa274d8e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-02T14:14:05.540Z', 'started_at': None, 'finished_at': '2026-10-02T14:14:05.655Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]