vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #414
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.7BDPOUliTR', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 56.82 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab # Filesystem UUID: bfaa69ae-2c23-469a-819f-e13390502f7b17gitlab # Superblock backups stored on blocks:18gitlab # 32768, 98304, 163840, 22937619gitlab # 20gitlab # Allocating group tables: 0/8 done21gitlab # Writing inode tables: 0/8 done22gitlab # Creating journal (8192 blocks): done23gitlab: waiting for unit setup-gitlab.service24gitlab # Writing superblocks and filesystem accounting information: 0/8 done25gitlab: waiting for the VM to finish booting26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fb7qsq3vw1asjaf9arfm3lnzmi9g4qvp-nixos-system-gitlab-test/init regInfo=/nix/store/9avncpf0sf4csxiwhvy3i8nncxdajhl1-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 499696193 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000880] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002737] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002748] Using GB pages for direct mapping73gitlab # [ 0.002840] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002847] ACPI: Early table checksum verification disabled75gitlab # [ 0.002850] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002853] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002857] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002864] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002866] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002867] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002869] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002871] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002872] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002873] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002874] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002874] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002875] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002875] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003090] No NUMA configuration found90gitlab # [ 0.003091] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003093] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005144] Zone ranges:93gitlab # [ 0.005145] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005146] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005147] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005148] Device empty97gitlab # [ 0.005149] Movable zone start for each node98gitlab # [ 0.005149] Early memory node ranges99gitlab # [ 0.005150] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005151] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005152] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005153] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005173] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005414] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.104275] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.104697] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.104712] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.104743] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.104746] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.104747] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.104749] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.104750] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.104751] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.104753] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.104754] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.104759] TSC deadline timer available117gitlab # [ 0.104763] CPU topo: Max. logical packages: 1118gitlab # [ 0.104764] CPU topo: Max. logical dies: 1119gitlab # [ 0.104764] CPU topo: Max. dies per package: 1120gitlab # [ 0.104768] CPU topo: Max. threads per core: 1121gitlab # [ 0.104768] CPU topo: Num. cores per package: 4122gitlab # [ 0.104769] CPU topo: Num. threads per package: 4123gitlab # [ 0.104769] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.104793] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.104808] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.104811] kvm-guest: setup PV sched yield127gitlab # [ 0.104825] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.104827] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.104828] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.104829] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.104831] Booting paravirtualized kernel on KVM132gitlab # [ 0.104834] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.109284] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.111296] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.111347] kvm-guest: PV spinlocks enabled136gitlab # [ 0.111348] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.111351] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fb7qsq3vw1asjaf9arfm3lnzmi9g4qvp-nixos-system-gitlab-test/init regInfo=/nix/store/9avncpf0sf4csxiwhvy3i8nncxdajhl1-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.111443] Unknown kernel command line parameters "regInfo=/nix/store/9avncpf0sf4csxiwhvy3i8nncxdajhl1-closure-info/registration", will be passed to user space.139gitlab # [ 0.111456] random: crng init done140gitlab # [ 0.111456] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.119473] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.123549] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.123618] software IO TLB: area num 4.144gitlab # [ 0.190471] Fallback order for Node 0: 0145gitlab # [ 0.190478] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.190479] Policy zone: Normal147gitlab # [ 0.192766] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.201607] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.213804] allocated 12582912 bytes of page_ext150gitlab # [ 0.223468] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.223470] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.224276] Dynamic Preempt: lazy153gitlab # [ 0.224449] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.224449] rcu: RCU event tracing is enabled.155gitlab # [ 0.224450] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.224451] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.224452] Rude variant of Tasks RCU enabled.158gitlab # [ 0.224452] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.224453] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.224453] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.224472] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.224474] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.224475] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.228724] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.229000] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.229009] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.229124] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.232696] Console: colour VGA+ 80x25169gitlab # [ 0.232698] printk: legacy console [tty0] enabled170gitlab # [ 0.263555] printk: legacy console [ttyS0] enabled171gitlab # [ 0.371704] ACPI: Core revision 20250807172gitlab # [ 0.372629] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.374234] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.375240] x2apic enabled175gitlab # [ 0.376019] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.377000] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.378326] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.379854] kvm-guest: setup PV IPIs179gitlab # [ 0.381597] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.382686] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.384520] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.385603] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.387566] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.389517] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.390521] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.392518] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.393517] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.394517] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.395517] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.396517] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.397524] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.398518] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.399518] active return thunk: srso_alias_return_thunk194gitlab # [ 0.401232] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.402517] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.403517] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.404517] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.405517] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.406517] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.407517] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.409517] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.410517] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.411517] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.412517] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.413517] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.414517] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.443974] Freeing SMP alternatives memory: 44K208gitlab # [ 0.444520] pid_max: default: 32768 minimum: 301209gitlab # [ 0.445617] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.446620] landlock: Up and running.211gitlab # [ 0.447518] Yama: becoming mindful.212gitlab # [ 0.448531] LSM support for eBPF active213gitlab # [ 0.449440] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.450644] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.453345] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.454052] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.454522] ... version: 2218gitlab # [ 0.455271] ... bit width: 48219gitlab # [ 0.455519] ... generic counters: 6220gitlab # [ 0.456309] ... generic bitmap: 000000000000003f221gitlab # [ 0.457291] ... fixed-purpose counters: 0222gitlab # [ 0.457519] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.458476] ... value mask: 0000ffffffffffff224gitlab # [ 0.459292] ... max period: 00007fffffffffff225gitlab # [ 0.459519] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.460608] signal: max sigframe size: 3376227gitlab # [ 0.461421] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.462147] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.462700] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.468345] smp: Bringing up secondary CPUs ...231gitlab # [ 0.469535] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.470426] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.473673] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.475267] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.475877] Memory: 6011604K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.477519] devtmpfs: initialized237gitlab # [ 0.478570] x86/mm: Memory block size: 128MB238gitlab # [ 0.481691] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.482629] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.483597] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.484830] PM: RTC time: 17:39:30, date: 2026-10-04242gitlab # [ 0.488191] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.489722] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.490563] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.492510] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.493530] audit: initializing netlink subsys (disabled)247gitlab # [ 0.494550] audit: type=2000 audit(1791135570.723:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.494773] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.496520] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.497519] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.498519] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.499519] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.500532] cpuidle: using governor menu254gitlab # [ 0.502715] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.503748] PCI: Using configuration type 1 for base access256gitlab # [ 0.504520] PCI: Using configuration type 1 for extended access257gitlab # [ 0.505692] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.507915] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.508522] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.509520] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.510519] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.516004] ACPI: Added _OSI(Module Device)263gitlab # [ 0.517526] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.519529] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.526435] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.535709] ACPI: Interpreter enabled267gitlab # [ 0.536649] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.538530] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.540794] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.544525] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.548037] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.560828] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.566530] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.568988] acpiphp: Slot [3] registered275gitlab # [ 0.569561] acpiphp: Slot [4] registered276gitlab # [ 0.570269] acpiphp: Slot [5] registered277gitlab # [ 0.571543] acpiphp: Slot [6] registered278gitlab # [ 0.572284] acpiphp: Slot [7] registered279gitlab # [ 0.572590] acpiphp: Slot [8] registered280gitlab # [ 0.574571] acpiphp: Slot [9] registered281gitlab # [ 0.575546] acpiphp: Slot [10] registered282gitlab # [ 0.576300] acpiphp: Slot [11] registered283gitlab # [ 0.576555] acpiphp: Slot [12] registered284gitlab # [ 0.577299] acpiphp: Slot [13] registered285gitlab # [ 0.578542] acpiphp: Slot [14] registered286gitlab # [ 0.579313] acpiphp: Slot [15] registered287gitlab # [ 0.579555] acpiphp: Slot [16] registered288gitlab # [ 0.580281] acpiphp: Slot [17] registered289gitlab # [ 0.581542] acpiphp: Slot [18] registered290gitlab # [ 0.582317] acpiphp: Slot [19] registered291gitlab # [ 0.582542] acpiphp: Slot [20] registered292gitlab # [ 0.583234] acpiphp: Slot [21] registered293gitlab # [ 0.584546] acpiphp: Slot [22] registered294gitlab # [ 0.585367] acpiphp: Slot [23] registered295gitlab # [ 0.586102] acpiphp: Slot [24] registered296gitlab # [ 0.586540] acpiphp: Slot [25] registered297gitlab # [ 0.587293] acpiphp: Slot [26] registered298gitlab # [ 0.587550] acpiphp: Slot [27] registered299gitlab # [ 0.588327] acpiphp: Slot [28] registered300gitlab # [ 0.589540] acpiphp: Slot [29] registered301gitlab # [ 0.590274] acpiphp: Slot [30] registered302gitlab # [ 0.590553] acpiphp: Slot [31] registered303gitlab # [ 0.591313] PCI host bridge to bus 0000:00304gitlab # [ 0.592524] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.593522] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.594521] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.596519] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.597526] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.598535] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.600961] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.603166] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.605120] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.609333] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.610407] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.611521] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.612521] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.614522] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.615757] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.619269] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.621708] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.623867] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.625531] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.626835] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.640619] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.642539] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.643579] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.644745] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.647505] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.652560] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.653529] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.655576] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.670531] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.673115] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.678551] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.679531] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.681552] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.684993] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.690556] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.692530] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.693549] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.696723] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.701551] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.702529] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.703549] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.707634] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.712548] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.713489] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.714321] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.716800] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.720559] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.721495] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.722332] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.724737] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.729550] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.730475] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.731328] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.732525] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.734748] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.737555] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.738543] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.741774] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.744566] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.745501] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.746345] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.748785] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.752547] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.753527] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.754541] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.759244] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.761682] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.762997] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.765906] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.768807] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.775073] iommu: Default domain type: Translated375gitlab # [ 0.777527] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.780690] ACPI: bus type USB registered377gitlab # [ 0.782712] usbcore: registered new interface driver usbfs378gitlab # [ 0.784711] usbcore: registered new interface driver hub379gitlab # [ 0.787557] usbcore: registered new device driver usb380gitlab # [ 0.792213] NetLabel: Initializing381gitlab # [ 0.793524] NetLabel: domain hash size = 128382gitlab # [ 0.795526] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.797600] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.800559] PCI: Using ACPI for IRQ routing385gitlab # [ 0.802761] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.803516] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.803516] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.811536] vgaarb: loaded389gitlab # [ 0.813069] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.815524] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.820654] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.825839] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.827285] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.830399] pnp: PnP ACPI init395gitlab # [ 0.831973] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.844062] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.847886] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.850582] NET: Registered PF_INET protocol family399gitlab # [ 0.855583] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.888838] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.890421] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.891904] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.895471] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.896892] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.898385] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.900055] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.901531] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.902950] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.904000] NET: Registered PF_XDP protocol family410gitlab # [ 0.904878] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.905928] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.907013] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.908169] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.909339] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.910757] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.911839] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.914320] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.916856] PCI: CLS 0 bytes, default 64419gitlab # [ 0.917698] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.917962] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.918797] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.918916] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 0.942205] Initialise system trusted keyrings424gitlab # [ 0.943347] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.955048] Key type asymmetric registered426gitlab # [ 0.955821] Asymmetric key parser 'x509' registered427gitlab # [ 0.956790] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.958404] io scheduler mq-deadline registered429gitlab # [ 0.959231] io scheduler kyber registered430gitlab # [ 0.963166] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.964657] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.967168] Linux agpgart interface v0.103433gitlab # [ 0.967949] ACPI: bus type drm_connector registered434gitlab # [ 0.970355] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.971494] usbserial: USB Serial support registered for generic436gitlab # [ 0.972550] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.972550] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.974904] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.976369] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.977593] NET: Registered PF_INET6 protocol family441gitlab # [ 0.979542] Segment Routing with IPv6442gitlab # [ 0.980258] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.983120] IPI shorthand broadcast: enabled444gitlab # [ 0.987618] sched_clock: Marking stable (840011956, 147508023)->(1010674667, -23154688)445gitlab # [ 0.989420] registered taskstats version 1446gitlab # [ 0.990482] Loading compiled-in X.509 certificates447gitlab # [ 1.000252] Demotion targets for Node 0: null448gitlab # [ 1.001301] Key type .fscrypt registered449gitlab # [ 1.002034] Key type fscrypt-provisioning registered450gitlab # [ 1.003152] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.004132] ima: Allocated hash algorithm: sha1452gitlab # [ 1.004972] ima: No architecture policies found453gitlab # [ 1.006019] PM: Magic number: 14:261:693454gitlab # [ 1.007646] RAS: Correctable Errors collector initialized.455gitlab # [ 1.012236] clk: Disabling unused clocks456gitlab # [ 1.012963] PM: genpd: Disabling unused power domains457gitlab # [ 1.189615] Freeing initrd memory: 29392K458gitlab # [ 1.193063] Freeing unused decrypted memory: 2028K459gitlab # [ 1.195705] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.196820] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.198883] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.200495] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.251958] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.253111] Run /init as init process465gitlab # [ 1.265691] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.288260] fuse: init (API version 7.45)467gitlab # [ 1.296381] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.303480] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.306679] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.349182] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.685018] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.721828] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.724013] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.726280] systemd[1]: Running in initrd.475gitlab # [ 1.728809] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.731823] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.857137] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.917656] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.930148] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.932481] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.935305] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.937638] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.939823] systemd[1]: Reached target Path Units.484gitlab # [ 1.941607] systemd[1]: Reached target Slice Units.485gitlab # [ 1.943197] systemd[1]: Reached target Swaps.486gitlab # [ 1.944020] systemd[1]: Reached target Timer Units.487gitlab # [ 1.945044] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.946312] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.947484] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.948540] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.949609] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.950601] systemd[1]: Reached target Socket Units.493gitlab # [ 1.952924] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.958205] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.969234] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.975938] systemd[1]: Starting Journal Service...497gitlab # [ 1.980361] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 1.982821] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 1.988683] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 1.997464] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 1.997703] systemd-journald[90]: Collecting audit messages is disabled.502gitlab # [ 2.002346] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.020461] netfs: FS-Cache loaded504gitlab # [ 2.022063] systemd[1]: Finished Load Kernel Module configfs.505gitlab # [ 2.023646] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 2.026605] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 2.030605] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.035709] 9pnet: Installing 9P2000 support509gitlab # [ 2.035759] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev510gitlab # [ 2.041480] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.046712] systemd[1]: Starting Apply Kernel Variables...512gitlab # [ 2.048152] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.053901] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 1.906542] systemd-modules-load[91]: Using 4 probe threads515gitlab # [ 2.055478] systemd[1]: Started Journal Service.516gitlab # [ 1.908840] systemd-modules-load[91]: Inserted module 'virtio_balloon'517gitlab # [ 1.910215] systemd-modules-load[91]: Inserted module 'dm_mod'518gitlab # [ 1.911265] systemd-modules-load[91]: Inserted module 'virtio_gpu'519gitlab # [ 1.912617] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.520gitlab # [ 1.913893] systemd[1]: Starting Create Static Device Nodes in /dev...521gitlab # [ 1.917955] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.932472] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.933859] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.934786] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.936345] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.938234] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.958481] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.966654] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 1.977071] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 1.986137] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 1.987030] systemd[1]: Reached target System Initialization.532gitlab # [ 1.987874] systemd[1]: Reached target Basic System.533gitlab # [ 2.241036] SCSI subsystem initialized534gitlab # [ 2.243388] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.244302] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.246077] uhci_hcd 0000:00:01.2: detected 2 ports537gitlab # [ 2.247175] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.248332] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.249785] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.251256] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.251977] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd542gitlab # [ 2.253025] usb usb1: SerialNumber: 0000:00:01.2543gitlab # [ 2.260821] virtio_blk virtio4: 4/0/0 default/read/poll queues544gitlab # [ 2.266530] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)545gitlab # [ 2.272750] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12546gitlab # [ 2.274701] serio: i8042 KBD port at 0x60,0x64 irq 1547gitlab # [ 2.275438] serio: i8042 AUX port at 0x60,0x64 irq 12548gitlab # [ 2.280359] virtio_blk virtio5: 4/0/0 default/read/poll queues549gitlab # [ 2.283809] hub 1-0:1.0: USB hub found550gitlab # [ 2.284615] hub 1-0:1.0: 2 ports detected551gitlab # [ 2.284657] scsi host0: ata_piix552gitlab # [ 2.287638] scsi host1: ata_piix553gitlab # [ 2.288342] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0554gitlab # [ 2.289474] virtio_blk virtio5: [vdb] 11952752 512-byte logical blocks (6.12 GB/5.70 GiB)555gitlab # [ 2.289626] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.173249] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 2.178882] (udev-worker)[133]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.181207] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.183656] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.199863] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 2.201558] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 2.448848] ata2: found unknown device (class 0)563gitlab # [ 2.451631] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100564gitlab # [ 2.456143] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5565gitlab # [ 2.485238] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0566gitlab # [ 2.506595] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.364851] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.370604] systemd[1]: Found device /dev/disk/by-label/nix-store.569gitlab # [ 2.373468] s[ 2.520710] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray570gitlab # ystemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.377604] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.560167] cdrom: Uniform CD-ROM driver Revision: 3.20573gitlab # [ 2.421717] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks574gitlab # [ 2.429580] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.575gitlab # [ 2.674476] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.677582] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.680213] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.681855] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.683355] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.714085] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.728014] usbcore: registered new interface driver usbhid582gitlab # [ 2.730165] usbhid: USB HID core driver583gitlab # [ 2.739738] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.743470] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.851604] systemd[1]: Mounting /sysroot...586gitlab # [ 3.148403] EXT4-fs (vda): mounted filesystem bfaa69ae-2c23-469a-819f-e13390502f7b r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.007916] systemd[1]: Mounted /sysroot.588gitlab # [ 3.009549] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.013374] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.015566] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.017569] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.025198] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.033236] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.037238] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.191597] erofs (device vdb): mounted with root inode @ nid 128.596gitlab # [ 3.046369] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.048427] systemd[1]: Mounted /sysroot/nix/.ro-store.598gitlab # [ 3.051163] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.055368] systemd[1]: Starting rw-sysroot-nix-store.service...600gitlab # [ 3.204961] 9p: Installing v9fs 9p2000 file system support601gitlab # [ 3.057971] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.602gitlab # [ 3.061409] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...603gitlab # [ 3.064273] systemd[1]: Reloading...604gitlab # [ 3.123600] systemd[1]: Reloading finished in 61 ms.605gitlab # [ 3.151587] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...606gitlab # [ 3.154719] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.156731] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.158651] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.161493] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.163667] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...611gitlab # [ 3.166438] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.168669] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.171208] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.173585] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.183840] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.186639] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.851618] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.899865] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.901719] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.903625] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.905747] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.937179] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.939752] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.953848] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.955833] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.957956] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 3.990804] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 3.992991] systemd[1]: Stopped target Basic System.629gitlab # [ 3.994829] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 3.996695] systemd[1]: Stopped target Path Units.631gitlab # [ 3.998337] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.000921] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.003538] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.007224] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.012117] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.014928] systemd[1]: Stopped target Swaps.637gitlab # [ 4.016964] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.018837] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.020896] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.023068] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.025526] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.027257] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.030388] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.032160] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.033963] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.035459] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.037358] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.038831] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.040909] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.043059] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.045106] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.046855] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.048072] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.049519] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.050912] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.052124] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.053596] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.055077] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.056279] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.057650] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.058995] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.060404] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.061652] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.063075] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.064465] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.065922] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.067189] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.068339] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.069641] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.070807] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.072223] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.073531] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.074860] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.078874] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.080256] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.081311] systemd[1]: Reached target Switch Root.677gitlab # [ 4.082361] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.229277] initrd-nixos-activation-start[228]: booting system configuration /nix/store/fb7qsq3vw1asjaf9arfm3lnzmi9g4qvp-nixos-system-gitlab-test679gitlab # [ 4.281283] initrd-nixos-activation-start[228]: running activation script...680gitlab # [ 4.519544] initrd-nixos-activation-start[251]: setting up /etc...681gitlab # [ 4.629894] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.632525] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.634231] systemd[1]: Starting Switch Root...684gitlab # [ 4.662895] systemd[1]: Switching root.685gitlab # [ 4.875158] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.986257] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.357366] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.367713] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.369536] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.371542] systemd[1]: Detected first boot.691gitlab # [ 5.374024] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.521079] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.611807] systemd[1]: Applying preset policy.694gitlab # [ 5.746360] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.865079] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.866518] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.868755] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.870980] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.872421] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.874041] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.874966] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.876266] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.877387] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.878137] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.878896] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.879769] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.880644] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.881497] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.882433] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.883490] systemd[1]: Reached target Path Units.711gitlab # [ 5.884209] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.885137] systemd[1]: Reached target Slice Units.713gitlab # [ 5.885935] systemd[1]: Reached target Swaps.714gitlab # [ 5.887316] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.889361] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.890853] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.892441] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.893487] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.895840] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.897269] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.899216] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.900493] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.901679] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.903052] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.905803] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.906849] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.907732] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.910919] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.913067] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.915073] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.918738] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.923236] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.924279] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.928795] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.932796] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.936655] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.940692] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.949082] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.951597] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.987405] systemd[1]: Starting Journal Service...741gitlab # [ 5.991082] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.995063] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.999548] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.000618] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.005547] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.007686] systemd-journald[321]: Collecting audit messages is enabled.747gitlab # [ 6.008552] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.009854] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.010807] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.011848] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.012886] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 6.014299] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 6.015710] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 6.017909] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 6.019309] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 5.873079] systemd[1]: Queue[ 6.020505] systemd[1]: Started Journal Service.757gitlab # d start job for default target M[ 6.021785] EXT4-fs (vda): re-mounted bfaa69ae-2c23-469a-819f-e13390502f7b.758gitlab # ulti-User System.759gitlab # [ 5.876683] systemd[1]: Unnecessary job was removed for /dev/vdb.760gitlab # [ 5.881399] systemd[1]: systemd-journald.service: Deactivated successfully.761gitlab # [ 5.883690] systemd-modules-load[322]: Using 3 probe threads762gitlab # [ 5.885309] systemd[1]: Mounting Kernel Configuration File System...763gitlab # [ 5.886951] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...764gitlab # [ 5.888803] systemd[1]: Finished Remount Root and Kernel File Systems.765gitlab # [ 5.890905] systemd[1]: Listening on Disk Image Download Service Socket.766gitlab # [ 5.899093] systemd[1]: Starting Flush Journal to Persistent Storage...767gitlab # [ 5.904191] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 5.906274] systemd-modules-load[322]: Inserted module 'tls'769gitlab # [ 5.907237] systemd[1]: Starting Load/Save OS Random Seed...770gitlab # [ 5.908254] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os771gitlab # [ 5.910160] systemd[1]: Mounted Kernel Configuration File System.772gitlab # [ 6.062312] loop: module loaded773gitlab # [ 5.915597] systemd-modules-load[322]: Inserted module 'loop'774gitlab # [ 5.917488] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.775gitlab # [ 6.068712] systemd-journald[321]: Received client request to flush runtime journal.776gitlab # [ 5.961254] systemd[1]: Finished Load Kernel Modules.777gitlab # [ 5.963161] systemd[1]: Starting Firewall...778gitlab # [ 5.965153] systemd[1]: Starting Apply Kernel Variables...779gitlab # [ 5.966375] systemd-oomd[324]: No swap; memory pressure usage will be degraded780gitlab # [ 5.968443] systemd[1]: Starting Create Static Device Nodes in /dev...781gitlab # [ 5.969879] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.782gitlab # [ 5.970879] systemd[1]: Finished Load/Save OS Random Seed.783gitlab # [ 5.971704] systemd[1]: Reached target First Boot Complete.784gitlab # [ 5.972537] systemd[1]: Finished Create Static Device Nodes in /dev.785gitlab # [ 5.973469] systemd[1]: Reached target Preparation for Local File Systems.786gitlab # [ 5.974530] systemd[1]: Starting Rule-based Manager for Device Events and Files...787gitlab # [ 5.975603] systemd[1]: Finished Apply Kernel Variables.788gitlab # [ 5.976486] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 5.977816] systemd-udevd[353]: Using default interface naming scheme 'v261'.790gitlab # [ 6.015551] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.016453] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.081096] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.101375] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.116100] (udev-worker)[392]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.118451] (udev-worker)[392]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.137633] (udev-worker)[402]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.141302] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 6.142965] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore799gitlab # [ 6.144578] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67800gitlab # [ 6.146861] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore801gitlab # [ 6.148593] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os802gitlab # [ 6.150061] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.336593] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3804gitlab # [ 6.199191] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.805gitlab # [ 6.359550] ACPI: button: Power Button [PWRF]806gitlab # [ 6.367845] rtc_cmos 00:05: RTC can wake from S4807gitlab # [ 6.382338] rtc_cmos 00:05: registered as rtc0808gitlab # [ 6.382565] Floppy drive(s): fd0 is 2.88M AMI BIOS809gitlab # [ 6.383273] rtc_cmos 00:05: setting system clock to 2026-10-04T17:39:35 UTC (1791135575)810gitlab # [ 6.383937] systemd-journald[321]: Time jumped backwards, rotating.811gitlab # [ 6.384566] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs812gitlab # [ 6.398836] FDC 0 is a S82078B813gitlab # [ 6.404218] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0814gitlab # [ 6.405675] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD815gitlab # [ 6.406088] parport_pc 00:03: reported by Plug and Play ACPI816gitlab # [ 6.416249] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]817gitlab # [ 6.419125] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console818gitlab # [ 6.419181] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4819gitlab # [ 6.434995] Console: switching to colour dummy device 80x25820gitlab # [ 6.435760] [drm] Found bochs VGA, ID 0xb0c5.821gitlab # [ 6.435762] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.822gitlab # [ 6.438892] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic823gitlab # [ 6.439745] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0824gitlab # [ 6.446936] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6825gitlab # [ 6.454672] Console: switching to colour frame buffer device 160x50826gitlab # [ 6.456890] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device827gitlab # [ 6.459701] mousedev: PS/2 mouse device common for all mice828gitlab # [ 6.460659] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 6.341573] systemd[1]: Finished Firewall.830gitlab # [ 6.365230] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.383726] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.385584] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.399633] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.558398] ppdev: user-space parallel port driver835gitlab # [ 6.414029] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 6.415294] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 6.416684] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.585468] kvm_amd: TSC scaling supported839gitlab # [ 6.586057] kvm_amd: Nested Virtualization enabled840gitlab # [ 6.586710] kvm_amd: Nested Paging enabled841gitlab # [ 6.587241] kvm_amd: LBR virtualization supported842gitlab # [ 6.587888] kvm_amd: Virtual VMLOAD VMSAVE supported843gitlab # [ 6.588551] kvm_amd: Virtual GIF supported844gitlab # [ 6.589042] kvm_amd: Virtual NMI enabled845gitlab # [ 6.621675] EDAC MC: Ver: 3.0.0846gitlab # [ 6.488148] systemd-vconsole-setup[496]: Configuration of first virtual console was skipped, ignoring remaining ones.847gitlab # [ 6.491216] systemd[1]: Finished Virtual Console Setup.848gitlab # [ 6.720887] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.745434] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.747489] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.749537] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.751787] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.756163] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.758340] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.761359] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.769205] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.796350] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.803139] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.820768] systemd[1]: Finished Create System Files and Directories.860gitlab # [ 6.823306] systemd[1]: Starting Rebuild Journal Catalog...861gitlab # [ 6.825680] systemd[1]: Starting Record System Boot/Shutdown in UTMP...862gitlab # [ 6.844196] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.864082] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.867559] systemd[1]: Starting Update is Completed...865gitlab # [ 6.883491] systemd[1]: Finished Update is Completed.866gitlab # [ 6.914117] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.915170] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 7.196232] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 7.197659] systemd[1]: Reached target System Initialization.870gitlab # [ 7.198968] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 7.200496] systemd[1]: Started logrotate.timer.872gitlab # [ 7.201624] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 7.203133] systemd[1]: Reached target Timer Units.874gitlab # [ 7.204335] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 7.205678] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 7.211205] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 7.212559] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 7.214781] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 7.216258] systemd[1]: Reached target Socket Units.880gitlab # [ 7.218706] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 7.290080] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 7.293272] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.296119] dbus-broker-launch[578]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.302121] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.314395] dbus-broker-launch[578]: Ready886gitlab # [ 7.317259] systemd[1]: Reached target Basic System.887gitlab # [ 7.320070] systemd[1]: Started backdoor.service.888gitlab # [ 7.324164] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.326958] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.339241] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.343432] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.350487] systemd[1]: Starting Post-Boot Actions...893gitlab # connecting to host...894gitlab # [ 7.361357] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.895gitlab # [ 7.364214] logrotate[583]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf896gitlab # [ 7.366124] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'897gitlab # [ 7.367547] logrotate[583]: Reading state from file: /var/lib/logrotate.status898gitlab # [ 7.368887] logrotate[583]: state file /var/lib/logrotate.status does not exist899gitlab # [ 7.370212] logrotate[583]: Allocating hash table for state file, size 64 entries900gitlab: Guest shell says: b'Spawning backdoor root shell...\n'901gitlab # [ 7.375140] logrotate[583]: Handling 4 logs902gitlab: connected to guest root shell903gitlab # [ 7.375874] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab: (connecting took 8.03 seconds)905gitlab # [ 7.378236] logrotate[583]: considering log /var/log/btmp906gitlab: (finished: waiting for the VM to finish booting, in 8.03 seconds)907gitlab # [ 7.379127] logrotate[583]: Creating new state908gitlab # [ 7.379886] logrotate[583]: Now: 2026-10-04 17:39909gitlab # [ 7.381213] logrotate[583]: Last rotated at 2026-10-04 17:00910gitlab # [ 7.381936] logrotate[583]: log does not need rotating (log has already been rotated)911gitlab # [ 7.382794] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed912gitlab # [ 7.383540] logrotate[583]: considering log /var/log/wtmp913gitlab # [ 7.384152] logrotate[583]: Creating new state914gitlab # [ 7.384709] logrotate[583]: Now: 2026-10-04 17:39915gitlab # [ 7.385407] logrotate[583]: Last rotated at 2026-10-04 17:00916gitlab # [ 7.386592] logrotate[583]: log does not need rotating (log has already been rotated)917gitlab # [ 7.387241] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed918gitlab # [ 7.387960] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)919gitlab # [ 7.388958] logrotate[583]: considering log /var/gitlab/state/log/*.log920gitlab # [ 7.389759] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping921gitlab # [ 7.390479] logrotate[583]: Creating new state922gitlab # [ 7.391138] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)923gitlab # [ 7.392187] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed924gitlab # [ 7.392252] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)925gitlab # [ 7.393882] logrotate[583]: considering log /var/log/nginx/*.log926gitlab # [ 7.394596] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping927gitlab # [ 7.395135] logrotate[583]: Creating new state928gitlab # [ 7.395625] logrotate[583]: not running postrotate script, since no logs were rotated929gitlab # [ 7.396196] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)930gitlab # [ 7.396711] systemd[1]: Started Reset console on configuration changes.931gitlab # [ 7.397309] systemd[1]: Starting resolvconf update...932gitlab # [ 7.398190] nsncd[584]: Oct 04 17:39:36.659 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab # [ 7.413342] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 7.416748] systemd[1]: Finished Logrotate configuration check.935gitlab # [ 7.417686] systemd[1]: Finished Post-Boot Actions.936gitlab # [ 7.423657] systemd[1]: Finished Import lastlog data into lastlog2 database.937gitlab # [ 7.427310] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 7.429096] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 7.432092] systemd[1]: Starting User Login Management...940gitlab # [ 7.468827] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.469638] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.470432] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.472937] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.474077] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.475136] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.476863] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.479196] systemd[1]: nscd.service: Consumed 22ms CPU time over 131ms wall clock time, 7.5M memory peak, 5.5M read from disk.948gitlab # [ 7.485408] systemd-logind[626]: New seat seat0.949gitlab # [ 7.487071] systemd[1]: Starting Name Service Cache Daemon (nsncd)...950gitlab # [ 7.488095] systemd-logind[626]: Watching system buttons on /dev/input/event2 (Power Button)951gitlab # [ 7.488708] systemd-logind[626]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)952gitlab # [ 7.489760] systemd-logind[626]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)953gitlab # [ 7.492802] systemd[1]: Started User Login Management.954gitlab # [ 7.495147] systemd[1]: Starting linger-users.service...955gitlab # [ 7.501362] nsncd[675]: Oct 04 17:39:36.764 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.502163] systemd[1]: Started Name Service Cache Daemon (nsncd).957gitlab # [ 7.502661] systemd[1]: Reached target Host and Network Name Lookups.958gitlab # [ 7.503178] systemd[1]: Reached target User and Group Name Lookups.959gitlab # [ 7.511846] systemd[1]: Finished resolvconf update.960gitlab # [ 7.512692] systemd[1]: Reached target Preparation for Network.961gitlab # [ 7.516940] systemd[1]: Starting DHCP Client...962gitlab # [ 7.519235] systemd[1]: Starting Address configuration of eth1...963gitlab # [ 7.520818] systemd[1]: Starting Extra networking commands....964gitlab # [ 7.522087] systemd[1]: linger-users.service: Deactivated successfully.965gitlab # [ 7.524062] systemd[1]: Finished linger-users.service.966gitlab # [ 7.546687] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done967gitlab # [ 7.549162] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.554882] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.586188] dhcpcd[711]: dhcpcd-10.3.2 starting970gitlab # [ 7.586628] systemd[1]: Finished Extra networking commands..971gitlab # [ 7.588596] dhcpcd[765]: dev: loaded udev972gitlab # [ 7.589541] systemd[1]: Reached target Network.973gitlab # [ 7.590783] systemd[1]: Starting gitlab-workhorse.service...974gitlab # [ 7.594070] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.742550] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.743064] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.599063] systemd[1]: Starting PostgreSQL Server...978gitlab # [ 7.603340] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 7.609094] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.612419] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.628252] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.630466] systemd[1]: Started Getty on tty1.983gitlab # [ 7.632131] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.834618] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.838648] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.839637] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.841060] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.842309] cfg80211: failed to load regulatory.db989gitlab # [ 7.874733] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.729220] dhcpcd[765]: eth0: waiting for carrier991gitlab # [ 7.730274] dhcpcd[765]: eth0: carrier acquired992gitlab # [ 7.732428] dhcpcd[765]: DUID 00:01:00:01:32:55:4b:d8:52:54:00:12:34:56993gitlab # [ 7.733609] dhcpcd[765]: eth0: IAID 00:12:34:56994gitlab # [ 7.734449] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 7.753540] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres".996gitlab # [ 7.754435] nginx-pre-start[795]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok997gitlab # [ 7.755065] nginx-pre-start[795]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful998gitlab # [ 7.755790] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.999gitlab # [ 7.756654] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1000gitlab # [ 7.757773] postgresql-pre-start[792]: This user must also own the server process.1001gitlab # [ 7.758644] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started1002gitlab # [ 7.759411] redis-server[790]: Configuration loaded1003gitlab # [ 7.760185] redis[790]: monotonic clock: POSIX clock_gettime1004gitlab # [ 7.760828] redis[790]: Running mode=standalone, port=0.1005gitlab # [ 7.761557] redis[790]: Server initialized1006gitlab # [ 7.762167] redis[790]: Ready to accept connections unix1007gitlab # [ 7.762712] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8".1008gitlab # [ 7.763327] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8".1009gitlab # [ 7.763838] postgresql-pre-start[792]: The default text search configuration will be set to "english".1010gitlab # [ 7.764509] postgresql-pre-start[792]: Data page checksums are enabled.1011gitlab # [ 7.765200] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1012gitlab # [ 7.765742] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1013gitlab # [ 7.766403] postgresql-pre-start[792]: creating subdirectories ... ok1014gitlab # [ 7.766918] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix1015gitlab # [ 7.778291] systemd[1]: Started Redis Server - redis-gitlab.1016gitlab # [ 7.781422] systemd[1]: Started Nginx Web Server.1017gitlab # [ 7.804992] postgresql-pre-start[792]: selecting default "max_connections" ... 1001018gitlab # [ 7.844198] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 8.121702] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 8.240144] postgresql-pre-start[792]: selecting default time zone ... UTC1021gitlab # [ 8.243078] postgresql-pre-start[792]: creating configuration files ... ok1022gitlab # [ 8.354390] gitlab-workhorse[826]: time="2026-10-04T17:39:37Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 8.356107] gitlab-workhorse[826]: time="2026-10-04T17:39:37Z" level=info msg="Using redis/go-redis"1024gitlab # [ 8.357369] gitlab-workhorse[826]: time="2026-10-04T17:39:37Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 8.431066] postgresql-pre-start[792]: running bootstrap script ... ok1026gitlab # [ 8.867903] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok1027gitlab # [ 8.938578] dhcpcd[765]: eth0: soliciting a DHCP lease1028gitlab # [ 9.096024] NET: Registered PF_PACKET protocol family1029gitlab # [ 8.956604] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21030gitlab # [ 8.963239] dhcpcd[765]: eth0: probing address 10.0.2.15/241031gitlab # [ 9.143908] postgresql-pre-start[792]: syncing data to disk ... ok1032gitlab # [ 9.145298] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 9.146358] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 9.147867] postgresql-pre-start[792]: Success. You can now start the database server using:1035gitlab # [ 9.149364] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 9.253688] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 9.255414] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 9.256516] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 9.258787] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 9.267411] postgres[865]: [865] LOG: database system was shut down at 2026-10-04 17:39:38 GMT1041gitlab # [ 9.274864] postgres[852]: [852] LOG: database system is ready to accept connections1042gitlab # [ 9.278381] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 9.283652] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 9.381944] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[859]: mkdir -p /var/gitlab/state/home/.ssh: OK1045gitlab # [ 9.386912] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[859]: chmod 700 /var/gitlab/state/home/.ssh: OK1046gitlab # [ 9.444577] postgresql-setup-start[877]: CREATE DATABASE1047gitlab # [ 9.446924] systemd[1]: Finished gitlab-config.service.1048gitlab # [ 9.450331] systemd[1]: Started gitaly.service.1049gitlab # [ 9.467564] postgresql-setup-start[895]: CREATE ROLE1050gitlab # [ 9.476733] postgresql-setup-start[898]: ALTER DATABASE1051gitlab # [ 9.493170] postgresql-setup-start[903]: CREATE ROLE1052gitlab # [ 9.496250] systemd[1]: Finished PostgreSQL Setup Scripts.1053gitlab # [ 9.496928] systemd[1]: Reached target PostgreSQL.1054gitlab # [ 9.498992] systemd[1]: Starting gitlab-db-config.service...1055gitlab # [ 9.501145] systemd[1]: Starting gitlab-postgresql.service...1056gitlab # [ 9.580829] gitlab-postgresql-start[922]: CREATE DATABASE1057gitlab # [ 9.609575] gitlab-postgresql-start[927]: CREATE EXTENSION1058gitlab # [ 9.682492] gitlab-postgresql-start[929]: CREATE EXTENSION1059gitlab # [ 9.686120] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 9.890598] dhcpcd[765]: eth0: soliciting an IPv6 router1061gitlab # [ 9.891741] dhcpcd[765]: eth0: Router Advertisement from fe80::21062gitlab # [ 9.892761] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641063gitlab # [ 9.893805] dhcpcd[765]: eth0: adding route to fec0::/641064gitlab # [ 9.894960] dhcpcd[765]: eth0: adding default route via fe80::21065gitlab # [ 9.948434] gitaly[893]: time="2026-10-04T17:39:39.211Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8931066gitlab # [ 9.949689] gitaly[893]: time="2026-10-04T17:39:39.212Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8931067gitlab # [ 9.952306] gitaly[893]: time="2026-10-04T17:39:39.212Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8931068gitlab # [ 9.953165] gitaly[893]: time="2026-10-04T17:39:39.212Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8931069gitlab # [ 9.953910] gitaly[893]: time="2026-10-04T17:39:39.212Z" level=info msg="Starting Gitaly" pid=893 version=1070gitlab # [ 10.126934] gitaly[893]: time="2026-10-04T17:39:39.390Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=177 pid=8931071gitlab # [ 10.127859] gitaly[893]: time="2026-10-04T17:39:39.391Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8931072gitlab # [ 10.128631] gitaly[893]: time="2026-10-04T17:39:39.391Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8931073gitlab # [ 10.129248] gitaly[893]: time="2026-10-04T17:39:39.391Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-893/git-exec-4135445516.d/git pid=8931074gitlab # [ 10.139168] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="finished detecting git version" duration_ms=11 pid=8931075gitlab # [ 10.140183] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="using Git version" pid=893 version=2.53.g1076gitlab # [ 10.141826] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="clearing disk cache object folder" pid=893 storage=default1077gitlab # [ 10.142772] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1768293274 pid=893 storage=default1078gitlab # [ 10.143575] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1768293274 pid=893 storage=default1079gitlab # [ 10.144350] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8931080gitlab # [ 10.144930] gitaly[893]: time="2026-10-04T17:39:39.403Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8931081gitlab # [ 10.145777] gitaly[893]: time="2026-10-04T17:39:39.404Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1768293274 clear_duration_ms=0 pid=893 storage=default1082gitlab # [ 10.199716] gitaly[893]: time="2026-10-04T17:39:39.463Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8931083gitlab # [ 10.200603] gitaly[893]: time="2026-10-04T17:39:39.463Z" level=info msg="counting repositories" pid=8931084gitlab # [ 10.201257] gitaly[893]: time="2026-10-04T17:39:39.463Z" level=info msg="starting to count repositories" pid=893 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.201596] gitaly[893]: time="2026-10-04T17:39:39.463Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=893 schema=unix1086gitlab # [ 10.202058] gitaly[893]: time="2026-10-04T17:39:39.464Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=893 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.202547] gitaly[893]: time="2026-10-04T17:39:39.464Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8931088gitlab # [ 10.203065] gitaly[893]: time="2026-10-04T17:39:39.463Z" level=info msg="finished tempdir cleaner walk" pid=893 storage=default time_ms=01089gitlab # [ 10.210783] gitaly[893]: time="2026-10-04T17:39:39.474Z" level=info msg="listening at address" address=/run/gitaly/gitaly-893/sock.d/intern pid=893 schema=unix1090gitlab # [ 10.213351] gitaly[893]: time="2026-10-04T17:39:39.477Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8931091gitlab # [ 10.214060] gitaly[893]: time="2026-10-04T17:39:39.477Z" level=info msg="Started Gitaly" duration_ms=265 pid=8931092gitlab # [ 10.214530] gitaly[893]: time="2026-10-04T17:39:39.477Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8931093gitlab # [ 10.215023] gitaly[893]: time="2026-10-04T17:39:39.477Z" level=info msg="maintenance: daily scheduled" pid=893 scheduled="2026-10-05 12:00:00 +0000 UTC"1094gitlab # [ 11.012697] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 11.015939] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 11.047667] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.029782] gitaly[893]: time="2026-10-04T17:39:41.293Z" level=info msg="License database preloaded" duration_ms=2080 pid=8931098gitlab # [ 13.822859] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 13.825234] dhcpcd[765]: eth0: adding route to 10.0.2.0/241100gitlab # [ 13.827237] dhcpcd[765]: eth0: adding default route via 10.0.2.21101gitlab # [ 13.931849] systemd[1]: Started DHCP Client.1102gitlab # [ 13.934195] systemd[1]: Reached target Network is Online.1103gitlab # [ 40.178300] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[917]: W, [2026-10-04T17:40:09.441637 #917] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 42.051085] postgres[1307]: [1307] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 42.054523] postgres[1307]: [1307] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 42.057709] postgres[1307]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 42.060845] postgres[1307]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 42.063688] postgres[1307]: attidentity AS identity,1109gitlab # [ 42.065611] postgres[1307]: attgenerated as attgenerated1110gitlab # [ 42.067654] postgres[1307]: FROM pg_attribute a1111gitlab # [ 42.069382] postgres[1307]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 42.072354] postgres[1307]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 42.074601] postgres[1307]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 42.077922] postgres[1307]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 42.080278] postgres[1307]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 42.082489] postgres[1307]: ORDER BY a.attnum1117gitlab # [ 42.084217] postgres[1307]:1118gitlab # [ 45.298680] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1345]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 45.300712] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1345]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.392730] gitlab-workhorse[826]: time="2026-10-04T17:40:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.403507] gitlab-workhorse[826]: time="2026-10-04T17:40:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 59.835387] postgres[1411]: [1411] ERROR: relation "table_without_models" does not exist1123gitlab # [ 59.837710] postgres[1411]: [1411] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.412471] gitlab-workhorse[826]: time="2026-10-04T17:40:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 71.173383] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 71.178478] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 71.181444] systemd[1]: Starting gitlab.service...1128gitlab # [ 71.552969] bundle[1569]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 71.554331] bundle[1569]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 71.558375] bundle[1569]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 74.039687] sidekiq-cluster[1568]: {"severity":"INFO","time":"2026-10-04T17:40:43.287Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 74.240821] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.484Z","pid":1569,"message":"* Enabling systemd notification integration"}1133gitlab # [ 74.241914] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"Puma starting in cluster mode..."}1134gitlab # [ 74.242710] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 74.243527] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 74.244470] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Min threads: 0"}1137gitlab # [ 74.245175] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Max threads: 4"}1138gitlab # [ 74.245855] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Environment: production"}1139gitlab # [ 74.246625] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Master PID: 1569"}1140gitlab # [ 74.247489] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Workers: 2"}1141gitlab # [ 74.248200] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 74.248811] bundle[1569]: {"timestamp":"2026-10-04T17:40:43.504Z","pid":1569,"message":"* Preloading application"}1143gitlab # [ 78.413314] gitlab-workhorse[826]: time="2026-10-04T17:40:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 88.423396] gitlab-workhorse[826]: time="2026-10-04T17:40:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 95.692349] bundle[1569]: W, [2026-10-04T17:41:04.955723 #1569] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 97.707793] sidekiq-cluster[1599]: 2026-10-04T17:41:06.971Z pid=1599 tid=wif INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1599, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431411200}1147gitlab # [ 97.866615] sidekiq-cluster[1599]: W, [2026-10-04T17:41:07.130478 #1599] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 97.903387] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:07.167Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1149gitlab # [ 98.432774] gitlab-workhorse[826]: time="2026-10-04T17:41:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 99.673207] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.936Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 99.674302] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.936Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 99.693285] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.957Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 99.695388] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.959Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 99.697688] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.961Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 99.699859] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.963Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 99.702075] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.966Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 99.704330] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.968Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 99.706352] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.970Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 99.708123] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.972Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 99.709963] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.974Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 99.711799] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.975Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 99.713633] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.977Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 99.715912] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.979Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 99.717803] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.981Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 99.719608] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.983Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 99.721474] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.985Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 99.723345] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.987Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 99.725784] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.989Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 99.728396] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.992Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 99.730852] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.994Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 99.733191] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.997Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 99.735656] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:08.999Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 99.737836] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.001Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 99.739990] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.004Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 99.741917] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.005Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 99.744456] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.008Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 99.746893] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.010Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 99.749336] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.013Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 99.751687] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.015Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 99.753989] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.018Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 99.756389] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.020Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 99.758316] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.022Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 99.760903] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.024Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 99.763351] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.027Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 99.765767] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.029Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 99.767862] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.031Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 99.769856] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.033Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 99.771746] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.035Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 99.773892] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.037Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 99.775968] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.040Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 99.777898] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.041Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 99.780102] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.044Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 99.781900] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.045Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 99.783971] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.048Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 99.786124] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.050Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 99.788700] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.052Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 99.790975] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.055Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 99.792824] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.056Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 99.795085] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.059Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 99.797478] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.061Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 99.802537] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.066Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 99.807386] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.071Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 99.812156] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.076Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 99.829087] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.093Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 99.834190] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.098Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 99.838711] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.102Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 99.843268] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.107Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 99.847888] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.111Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 99.852619] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.116Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 99.855473] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.119Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 99.858669] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.122Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 99.861499] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.125Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 99.864409] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.128Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 99.867811] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.131Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 99.871105] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.135Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 99.873529] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.137Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 99.878310] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.142Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 99.881213] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.145Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 99.913398] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.177Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 99.916417] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.180Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 99.919800] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.183Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 99.924925] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.187Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 99.928154] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.189Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 99.930454] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.191Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 99.931090] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.193Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 99.932575] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.196Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 99.936890] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.199Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 99.939057] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.201Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 99.941397] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.203Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 99.943714] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.205Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 99.944592] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.206Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 99.946876] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.210Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 99.949550] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.213Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 99.953058] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.217Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 99.956111] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.220Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 99.958556] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.222Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 99.964232] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.228Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 99.970875] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.234Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 99.975432] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.239Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 99.979588] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.243Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 99.983181] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.247Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 99.987181] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.251Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 99.990683] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.254Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 99.994236] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.258Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 99.998507] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.262Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 100.002385] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.266Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 100.006957] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.271Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 100.012318] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.276Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 100.017856] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.281Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 100.037338] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.301Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 100.041682] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.305Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 100.046600] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.310Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 100.053610] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.317Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 100.059879] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.323Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 100.065233] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.329Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 100.071246] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.335Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 100.075912] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.339Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 100.080272] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.344Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 100.088878] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.352Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 100.093058] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:09.357Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 108.442410] gitlab-workhorse[826]: time="2026-10-04T17:41:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 118.452684] gitlab-workhorse[826]: time="2026-10-04T17:41:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 123.849500] postgres[2028]: [2028] ERROR: relation "table_without_models" does not exist1264gitlab # [ 123.851049] postgres[2028]: [2028] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 125.207151] postgres[2039]: [2039] ERROR: relation "table_without_models" does not exist1266gitlab # [ 125.208407] postgres[2039]: [2039] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 126.353471] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:35.616Z","message":"Booted Rails 7.2.3.1 application in production environment"}1268gitlab # [ 126.358076] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:35.620Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1269gitlab # [ 126.362574] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:35.620Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1270gitlab # [ 126.366655] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:35.620Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1271gitlab # [ 126.371329] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:35.622Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1272gitlab # [ 127.698060] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:36.961Z","message":"Cleaning working queues"}1273gitlab # [ 127.701556] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:36.963Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a7b7570e3d9e774d0deefc75","created_at":"2026-10-04T17:40:40.140Z","trace_propagation_headers":{"sentry-trace":"16e60da64279469a8a829ad9a70ca9fe-141ce608f99d423c","baggage":"sentry-trace_id=16e60da64279469a8a829ad9a70ca9fe,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d1df6d8aa10dffd2066eb82d1851f3e0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T17:40:40.147Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a7b7570e3d9e774d0deefc75: start","job_status":"start","queue_duration_s":56.815347,"scheduling_latency_s":56.815412}1274gitlab # [ 127.863802] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:41:37.127Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a7b7570e3d9e774d0deefc75","created_at":"2026-10-04T17:40:40.140Z","trace_propagation_headers":{"sentry-trace":"16e60da64279469a8a829ad9a70ca9fe-141ce608f99d423c","baggage":"sentry-trace_id=16e60da64279469a8a829ad9a70ca9fe,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"d1df6d8aa10dffd2066eb82d1851f3e0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T17:40:40.147Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a7b7570e3d9e774d0deefc75: done: 0.164754 sec","job_status":"done","queue_duration_s":56.815347,"scheduling_latency_s":56.815412,"redis_calls":31,"redis_duration_s":0.005966,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.003914,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001204,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000848,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.078604964,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.164754,"completed_at":"2026-10-04T17:41:37.127Z","load_balancing_strategy":"primary","db_duration_s":0.040076,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1275gitlab # [ 127.950336] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.213Z","pid":1569,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1276gitlab # [ 127.950736] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.214Z","pid":1569,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1277gitlab # [ 127.951214] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.214Z","pid":1569,"message":"! #\u003cThread:0x00007c24dd6448c0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1278gitlab # [ 127.951987] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.214Z","pid":1569,"message":"! #\u003cThread:0x00007c24dd8ea4f8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1279gitlab # [ 127.952876] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.214Z","pid":1569,"message":"Use Ctrl-C to stop"}1280gitlab # [ 127.954088] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.214Z","pid":1569,"message":"Sending status to systemd every 1.0 sec"}1281gitlab # [ 128.250069] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.513Z","pid":1569,"message":"- Worker 0 (PID: 2138) booted in 0.26s, phase: 0"}1282gitlab # [ 128.283776] bundle[1569]: {"timestamp":"2026-10-04T17:41:37.547Z","pid":1569,"message":"- Worker 1 (PID: 2142) booted in 0.28s, phase: 0"}1283gitlab # [ 128.289443] systemd[1]: Started gitlab.service.1284gitlab # [ 128.291467] systemd[1]: Reached target Common target for all GitLab services..1285gitlab # [ 128.295906] systemd[1]: Starting setup-gitlab.service...1286gitlab # [ 128.315546] setup-gitlab-start[2166]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1287gitlab # [ 130.563287] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:41:39 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22171288gitlab # [ 130.568159] setup-gitlab-start[2166]: + TOKEN=nixbot-test-token-of-20-chars1289gitlab # [ 130.570567] setup-gitlab-start[2166]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1290gitlab # [ 130.582761] runuser[2190]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1291gitlab # [ 130.934724] setup-gitlab-start[2191]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1292gitlab # [ 130.935922] setup-gitlab-start[2191]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1293gitlab # [ 130.937355] setup-gitlab-start[2191]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1294gitlab # [ 131.480989] setup-gitlab-start[2191]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1295gitlab # [ 131.483142] setup-gitlab-start[2191]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1296gitlab # [ 131.484435] setup-gitlab-start[2191]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1297gitlab # [ 154.838440] setup-gitlab-start[2191]: W, [2026-10-04T17:42:04.101778 #2191] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1298gitlab # [ 155.838594] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"05edc15cf6b6119a237a21b3","created_at":"2026-10-04T17:42:05.057Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24f30d5122e41a7f754e010e02e8abd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.099Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-05edc15cf6b6119a237a21b3: start","job_status":"start","queue_duration_s":0.00208,"scheduling_latency_s":0.002125}1299gitlab # [ 155.900503] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"05edc15cf6b6119a237a21b3","created_at":"2026-10-04T17:42:05.057Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24f30d5122e41a7f754e010e02e8abd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.099Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-05edc15cf6b6119a237a21b3: done: 0.06322 sec","job_status":"done","queue_duration_s":0.00208,"scheduling_latency_s":0.002125,"redis_calls":12,"redis_duration_s":0.011674,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004365,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000593092,"duration_s":0.06322,"completed_at":"2026-10-04T17:42:05.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 155.946872] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e1d39c397ddd09af9a884d7f","created_at":"2026-10-04T17:42:05.109Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d26c2c03e623da99619ab85100a990d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.129Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e1d39c397ddd09af9a884d7f: start","job_status":"start","queue_duration_s":0.036957,"scheduling_latency_s":0.036972}1301gitlab # [ 155.947884] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.191Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1302gitlab # [ 155.948770] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e1d39c397ddd09af9a884d7f","created_at":"2026-10-04T17:42:05.109Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d26c2c03e623da99619ab85100a990d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.129Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e1d39c397ddd09af9a884d7f: done: 0.034488 sec","job_status":"done","queue_duration_s":0.036957,"scheduling_latency_s":0.036972,"redis_calls":10,"redis_duration_s":0.003702,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270984,"duration_s":0.034488,"completed_at":"2026-10-04T17:42:05.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 155.990403] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5448ddd8fff4c66381907375","created_at":"2026-10-04T17:42:05.136Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.148Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5448ddd8fff4c66381907375: start","job_status":"start","queue_duration_s":0.055332,"scheduling_latency_s":0.055348}1304gitlab # [ 156.208269] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.472Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5448ddd8fff4c66381907375","created_at":"2026-10-04T17:42:05.136Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.148Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5448ddd8fff4c66381907375: done: 0.26817 sec","job_status":"done","queue_duration_s":0.055332,"scheduling_latency_s":0.055348,"redis_calls":71,"redis_duration_s":0.135804,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.009324,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000656,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.124379,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002175416,"duration_s":0.26817,"completed_at":"2026-10-04T17:42:05.471Z","load_balancing_strategy":"primary","db_duration_s":0.003315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 156.209974] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bbc0ae02d9ed955a0a2c39d5","created_at":"2026-10-04T17:42:05.161Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b753c0f711144b0684196a4a93dd9f3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.166Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bbc0ae02d9ed955a0a2c39d5: start","job_status":"start","queue_duration_s":0.306585,"scheduling_latency_s":0.306601}1306gitlab # [ 156.324373] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bbc0ae02d9ed955a0a2c39d5","created_at":"2026-10-04T17:42:05.161Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b753c0f711144b0684196a4a93dd9f3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.166Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bbc0ae02d9ed955a0a2c39d5: done: 0.114717 sec","job_status":"done","queue_duration_s":0.306585,"scheduling_latency_s":0.306601,"redis_calls":10,"redis_duration_s":0.0074800000000000005,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000441,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000703441,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.114717,"completed_at":"2026-10-04T17:42:05.587Z","load_balancing_strategy":"primary","db_duration_s":0.018067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 156.326398] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8cc79c16a447aad286c37853","created_at":"2026-10-04T17:42:05.170Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adfc87eb77b88426d599bd52cb341ccc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.176Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8cc79c16a447aad286c37853: start","job_status":"start","queue_duration_s":0.413458,"scheduling_latency_s":0.413489}1308gitlab # [ 156.340915] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.604Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1309gitlab # [ 156.348533] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8cc79c16a447aad286c37853","created_at":"2026-10-04T17:42:05.170Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adfc87eb77b88426d599bd52cb341ccc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.176Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8cc79c16a447aad286c37853: done: 0.022075 sec","job_status":"done","queue_duration_s":0.413458,"scheduling_latency_s":0.413489,"redis_calls":10,"redis_duration_s":0.002555,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037407,"duration_s":0.022075,"completed_at":"2026-10-04T17:42:05.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 156.376805] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2570f3ba7075fc2aa6a7339a","created_at":"2026-10-04T17:42:05.187Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb6d825747fd6393740a5a1fd1cb399","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.191Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2570f3ba7075fc2aa6a7339a: start","job_status":"start","queue_duration_s":0.421897,"scheduling_latency_s":0.421921}1311gitlab # [ 156.388417] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2570f3ba7075fc2aa6a7339a","created_at":"2026-10-04T17:42:05.187Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb6d825747fd6393740a5a1fd1cb399","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.191Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2570f3ba7075fc2aa6a7339a: done: 0.020467 sec","job_status":"done","queue_duration_s":0.421897,"scheduling_latency_s":0.421921,"redis_calls":12,"redis_duration_s":0.001533,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00030814,"exclusive_lock_hold_duration_s":0.007290033,"duration_s":0.020467,"completed_at":"2026-10-04T17:42:05.634Z","load_balancing_strategy":"primary","db_duration_s":0.005948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 156.430543] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1636e52bfcfa89621f50b54f","created_at":"2026-10-04T17:42:05.199Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dedab443f16c7c1ed097ce5be3f5715","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-04T17:42:05.203Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1636e52bfcfa89621f50b54f: start","job_status":"start","queue_duration_s":0.43156,"scheduling_latency_s":0.431574}1313gitlab # [ 156.436103] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.641Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1314gitlab # [ 156.439063] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"1636e52bfcfa89621f50b54f","created_at":"2026-10-04T17:42:05.199Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dedab443f16c7c1ed097ce5be3f5715","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-04T17:42:05.203Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-1636e52bfcfa89621f50b54f: done: 0.010359 sec","job_status":"done","queue_duration_s":0.43156,"scheduling_latency_s":0.431574,"redis_calls":10,"redis_duration_s":0.001228,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194159,"duration_s":0.010359,"completed_at":"2026-10-04T17:42:05.645Z","load_balancing_strategy":"primary","db_duration_s":0.000431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 156.475633] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"4e6eada1012ac3960390ca11","created_at":"2026-10-04T17:42:05.214Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52aa46f411f32de5b38fef652996dadd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.217Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-4e6eada1012ac3960390ca11: start","job_status":"start","queue_duration_s":0.428315,"scheduling_latency_s":0.428327}1316gitlab # [ 156.522756] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.747Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"4e6eada1012ac3960390ca11","created_at":"2026-10-04T17:42:05.214Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52aa46f411f32de5b38fef652996dadd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.217Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-4e6eada1012ac3960390ca11: done: 0.101546 sec","job_status":"done","queue_duration_s":0.428315,"scheduling_latency_s":0.428327,"redis_calls":12,"redis_duration_s":0.001683,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000286629,"exclusive_lock_hold_duration_s":0.089191782,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.101546,"completed_at":"2026-10-04T17:42:05.747Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01396,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1317gitlab # [ 156.526575] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8b7a72254c3f6b5fc69ad472","created_at":"2026-10-04T17:42:05.221Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.224Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8b7a72254c3f6b5fc69ad472: start","job_status":"start","queue_duration_s":0.524698,"scheduling_latency_s":0.524712}1318gitlab # [ 156.571881] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8b7a72254c3f6b5fc69ad472","created_at":"2026-10-04T17:42:05.221Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.224Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8b7a72254c3f6b5fc69ad472: done: 0.040205 sec","job_status":"done","queue_duration_s":0.524698,"scheduling_latency_s":0.524712,"redis_calls":19,"redis_duration_s":0.002511,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000206,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020226,"duration_s":0.040205,"completed_at":"2026-10-04T17:42:05.788Z","load_balancing_strategy":"primary","db_duration_s":0.00801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 156.575077] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"db2f28f5c55efb50f3d72c6a","created_at":"2026-10-04T17:42:05.232Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bbf328e441b3806ac92ad24f9d73751","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.235Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-db2f28f5c55efb50f3d72c6a: start","job_status":"start","queue_duration_s":0.554926,"scheduling_latency_s":0.55494}1320gitlab # [ 156.604100] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"db2f28f5c55efb50f3d72c6a","created_at":"2026-10-04T17:42:05.232Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bbf328e441b3806ac92ad24f9d73751","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.235Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-db2f28f5c55efb50f3d72c6a: done: 0.077854 sec","job_status":"done","queue_duration_s":0.554926,"scheduling_latency_s":0.55494,"redis_calls":12,"redis_duration_s":0.002412,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001142883,"exclusive_lock_hold_duration_s":0.021639342,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.077854,"completed_at":"2026-10-04T17:42:05.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 156.627224] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c144292e690e8c656dc3a7f4","created_at":"2026-10-04T17:42:05.239Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dda04cc9f863e1af2507114d73a0260","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-04T17:42:05.242Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c144292e690e8c656dc3a7f4: start","job_status":"start","queue_duration_s":0.626967,"scheduling_latency_s":0.626985}1322gitlab # [ 156.671934] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c144292e690e8c656dc3a7f4","created_at":"2026-10-04T17:42:05.239Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dda04cc9f863e1af2507114d73a0260","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-04T17:42:05.242Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c144292e690e8c656dc3a7f4: done: 0.021018 sec","job_status":"done","queue_duration_s":0.626967,"scheduling_latency_s":0.626985,"redis_calls":10,"redis_duration_s":0.001286,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236902,"duration_s":0.021018,"completed_at":"2026-10-04T17:42:05.890Z","load_balancing_strategy":"primary","db_duration_s":0.00332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 156.710729] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"66d5b62b2773a65b1cbcfcfc","created_at":"2026-10-04T17:42:05.243Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b81ca5e31518a0d299c7c65124f7d1c2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.246Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-66d5b62b2773a65b1cbcfcfc: start","job_status":"start","queue_duration_s":0.64472,"scheduling_latency_s":0.644735}1324gitlab # [ 156.711434] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"66d5b62b2773a65b1cbcfcfc","created_at":"2026-10-04T17:42:05.243Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b81ca5e31518a0d299c7c65124f7d1c2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.246Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-66d5b62b2773a65b1cbcfcfc: done: 0.019527 sec","job_status":"done","queue_duration_s":0.64472,"scheduling_latency_s":0.644735,"redis_calls":16,"redis_duration_s":0.0021060000000000002,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001105,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019835,"duration_s":0.019527,"completed_at":"2026-10-04T17:42:05.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 156.761733] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:05.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"61d6215618ebc7fcb45630a9","created_at":"2026-10-04T17:42:05.248Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e038ebcb4a4eed53c106742ee9d7cd7a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.250Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-61d6215618ebc7fcb45630a9: start","job_status":"start","queue_duration_s":0.660713,"scheduling_latency_s":0.660728}1326gitlab # [ 156.851995] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"61d6215618ebc7fcb45630a9","created_at":"2026-10-04T17:42:05.248Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e038ebcb4a4eed53c106742ee9d7cd7a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.250Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-61d6215618ebc7fcb45630a9: done: 0.20412 sec","job_status":"done","queue_duration_s":0.660713,"scheduling_latency_s":0.660728,"redis_calls":565,"redis_duration_s":0.060684,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.059732,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.166009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248914,"duration_s":0.20412,"completed_at":"2026-10-04T17:42:06.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 156.853580] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d8f12b5e508013f348e6e9f6","created_at":"2026-10-04T17:42:05.252Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b10d86a6655c26d9dc2aa4d79368ffc3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.257Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d8f12b5e508013f348e6e9f6: start","job_status":"start","queue_duration_s":0.859334,"scheduling_latency_s":0.85935}1328gitlab # [ 156.916532] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d8f12b5e508013f348e6e9f6","created_at":"2026-10-04T17:42:05.252Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b10d86a6655c26d9dc2aa4d79368ffc3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.257Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d8f12b5e508013f348e6e9f6: done: 0.01444 sec","job_status":"done","queue_duration_s":0.859334,"scheduling_latency_s":0.85935,"redis_calls":10,"redis_duration_s":0.001235,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019388,"duration_s":0.01444,"completed_at":"2026-10-04T17:42:06.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 156.925561] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8acf1e9816e58cbe2d3aa2e6","created_at":"2026-10-04T17:42:05.260Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db92b751d25c428f6c6e64524d577eb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.262Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8acf1e9816e58cbe2d3aa2e6: start","job_status":"start","queue_duration_s":0.869415,"scheduling_latency_s":0.869428}1330gitlab # [ 156.940187] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.138Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1331gitlab # [ 156.943946] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8acf1e9816e58cbe2d3aa2e6","created_at":"2026-10-04T17:42:05.260Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db92b751d25c428f6c6e64524d577eb2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.262Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8acf1e9816e58cbe2d3aa2e6: done: 0.010398 sec","job_status":"done","queue_duration_s":0.869415,"scheduling_latency_s":0.869428,"redis_calls":10,"redis_duration_s":0.001144,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191365,"duration_s":0.010398,"completed_at":"2026-10-04T17:42:06.142Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 156.997201] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.143Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"40c4cc1d96b7762547306d38","created_at":"2026-10-04T17:42:05.300Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36cf5d05826d6a89c0b1594c53373cb4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.307Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-40c4cc1d96b7762547306d38: start","job_status":"start","queue_duration_s":0.835243,"scheduling_latency_s":0.835256}1333gitlab # [ 157.042824] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"40c4cc1d96b7762547306d38","created_at":"2026-10-04T17:42:05.300Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36cf5d05826d6a89c0b1594c53373cb4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.307Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-40c4cc1d96b7762547306d38: done: 0.010344 sec","job_status":"done","queue_duration_s":0.835243,"scheduling_latency_s":0.835256,"redis_calls":12,"redis_duration_s":0.001447,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000185778,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.010344,"completed_at":"2026-10-04T17:42:06.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 157.045477] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a53f275689cc953cb54ca915","created_at":"2026-10-04T17:42:05.315Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"868c04bc35e30d19bf17ab4637286bc5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.321Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a53f275689cc953cb54ca915: start","job_status":"start","queue_duration_s":0.833228,"scheduling_latency_s":0.83324}1335gitlab # [ 157.089856] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.168Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"a53f275689cc953cb54ca915","created_at":"2026-10-04T17:42:05.315Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"868c04bc35e30d19bf17ab4637286bc5","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.321Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-a53f275689cc953cb54ca915: done: 0.014038 sec","job_status":"done","queue_duration_s":0.833228,"scheduling_latency_s":0.83324,"redis_calls":10,"redis_duration_s":0.001222,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204495,"duration_s":0.014038,"completed_at":"2026-10-04T17:42:06.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001582,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 157.133455] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"909a2f761af1d7671c4ea618","created_at":"2026-10-04T17:42:05.331Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"555b35a3264c0104275a7b896cdf1a4c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.340Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-909a2f761af1d7671c4ea618: start","job_status":"start","queue_duration_s":0.829006,"scheduling_latency_s":0.829018}1337gitlab # [ 157.134177] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"909a2f761af1d7671c4ea618","created_at":"2026-10-04T17:42:05.331Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"555b35a3264c0104275a7b896cdf1a4c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.340Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-909a2f761af1d7671c4ea618: done: 0.051869 sec","job_status":"done","queue_duration_s":0.829006,"scheduling_latency_s":0.829018,"redis_calls":13,"redis_duration_s":0.001961,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000731,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008499125,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.051869,"completed_at":"2026-10-04T17:42:06.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005243,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1338gitlab # [ 157.177486] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b79840e7267812671393ab1f","created_at":"2026-10-04T17:42:05.345Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b84bd72e82248293ee4f3ae1bead938c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.350Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b79840e7267812671393ab1f: start","job_status":"start","queue_duration_s":0.871238,"scheduling_latency_s":0.871253}1339gitlab # [ 157.178153] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b79840e7267812671393ab1f","created_at":"2026-10-04T17:42:05.345Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b84bd72e82248293ee4f3ae1bead938c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.350Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b79840e7267812671393ab1f: done: 0.011817 sec","job_status":"done","queue_duration_s":0.871238,"scheduling_latency_s":0.871253,"redis_calls":10,"redis_duration_s":0.0012259999999999999,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197232,"duration_s":0.011817,"completed_at":"2026-10-04T17:42:06.233Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 157.223750] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.235Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fbbb9fd51b02a4d1fb67599f","created_at":"2026-10-04T17:42:05.376Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b61f76b934fe537f9aa48ca448499ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.385Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fbbb9fd51b02a4d1fb67599f: start","job_status":"start","queue_duration_s":0.850247,"scheduling_latency_s":0.850277}1341gitlab # [ 157.224504] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fbbb9fd51b02a4d1fb67599f","created_at":"2026-10-04T17:42:05.376Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b61f76b934fe537f9aa48ca448499ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.385Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fbbb9fd51b02a4d1fb67599f: done: 0.029506 sec","job_status":"done","queue_duration_s":0.850247,"scheduling_latency_s":0.850277,"redis_calls":14,"redis_duration_s":0.001934,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0003168,"exclusive_lock_hold_duration_s":0.013117868,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.029506,"completed_at":"2026-10-04T17:42:06.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 157.259830] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.265Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2eccc98946e81238fe25044d","created_at":"2026-10-04T17:42:05.393Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7cba997d834c9a6767734080df05166","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.400Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2eccc98946e81238fe25044d: start","job_status":"start","queue_duration_s":0.865488,"scheduling_latency_s":0.865501}1343gitlab # [ 157.272142] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"2eccc98946e81238fe25044d","created_at":"2026-10-04T17:42:05.393Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7cba997d834c9a6767734080df05166","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.400Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-2eccc98946e81238fe25044d: done: 0.011921 sec","job_status":"done","queue_duration_s":0.865488,"scheduling_latency_s":0.865501,"redis_calls":12,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000298,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000211479,"duration_s":0.011921,"completed_at":"2026-10-04T17:42:06.277Z","load_balancing_strategy":"primary","db_duration_s":0.000253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 157.345560] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6abf679d8f466ddb0ebdf1a6","created_at":"2026-10-04T17:42:05.409Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5a8441b69cb8520fa4760170ef095a6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.416Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6abf679d8f466ddb0ebdf1a6: start","job_status":"start","queue_duration_s":0.861965,"scheduling_latency_s":0.861978}1345gitlab # [ 157.346172] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6abf679d8f466ddb0ebdf1a6","created_at":"2026-10-04T17:42:05.409Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5a8441b69cb8520fa4760170ef095a6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.416Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6abf679d8f466ddb0ebdf1a6: done: 0.013304 sec","job_status":"done","queue_duration_s":0.861965,"scheduling_latency_s":0.861978,"redis_calls":12,"redis_duration_s":0.001479,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0002992,"exclusive_lock_hold_duration_s":0.001685969,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.013304,"completed_at":"2026-10-04T17:42:06.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 157.400612] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0aefc8df0afdca288554fdb8","created_at":"2026-10-04T17:42:05.423Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a58bcf4d7abf3b6565f8d170843788b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-04T17:42:05.430Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0aefc8df0afdca288554fdb8: start","job_status":"start","queue_duration_s":0.86231,"scheduling_latency_s":0.862323}1347gitlab # [ 157.401215] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.299Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1348gitlab # [ 157.401760] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0aefc8df0afdca288554fdb8","created_at":"2026-10-04T17:42:05.423Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a58bcf4d7abf3b6565f8d170843788b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-04T17:42:05.430Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0aefc8df0afdca288554fdb8: done: 0.011878 sec","job_status":"done","queue_duration_s":0.86231,"scheduling_latency_s":0.862323,"redis_calls":10,"redis_duration_s":0.001166,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192203,"duration_s":0.011878,"completed_at":"2026-10-04T17:42:06.304Z","load_balancing_strategy":"primary","db_duration_s":0.000229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 157.444483] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"912baec94ddb3d4c9991ec5e","created_at":"2026-10-04T17:42:05.436Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91c3dc4616a95aff22d64e49db130446","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.444Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-912baec94ddb3d4c9991ec5e: start","job_status":"start","queue_duration_s":0.860946,"scheduling_latency_s":0.860959}1350gitlab # [ 157.445159] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"912baec94ddb3d4c9991ec5e","created_at":"2026-10-04T17:42:05.436Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91c3dc4616a95aff22d64e49db130446","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.444Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-912baec94ddb3d4c9991ec5e: done: 0.013895 sec","job_status":"done","queue_duration_s":0.860946,"scheduling_latency_s":0.860959,"redis_calls":12,"redis_duration_s":0.001569,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000284394,"exclusive_lock_hold_duration_s":0.002797003,"duration_s":0.013895,"completed_at":"2026-10-04T17:42:06.319Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 157.490583] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2a0a33b27666caa1ea220759","created_at":"2026-10-04T17:42:05.450Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7ba1f8e28db227bb9ad20c2baa3a1e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.458Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2a0a33b27666caa1ea220759: start","job_status":"start","queue_duration_s":0.86119,"scheduling_latency_s":0.861203}1352gitlab # [ 157.491504] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.326Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1353gitlab # [ 157.492402] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2a0a33b27666caa1ea220759","created_at":"2026-10-04T17:42:05.450Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7ba1f8e28db227bb9ad20c2baa3a1e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.458Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2a0a33b27666caa1ea220759: done: 0.010551 sec","job_status":"done","queue_duration_s":0.86119,"scheduling_latency_s":0.861203,"redis_calls":10,"redis_duration_s":0.0011949999999999999,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212597,"duration_s":0.010551,"completed_at":"2026-10-04T17:42:06.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 157.521653] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af38b0250cbcaa7fdc4cf523","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af38b0250cbcaa7fdc4cf523: start","job_status":"start","queue_duration_s":0.87102,"scheduling_latency_s":0.871032}1355gitlab # [ 157.532979] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af38b0250cbcaa7fdc4cf523","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af38b0250cbcaa7fdc4cf523: done: 0.013972 sec","job_status":"done","queue_duration_s":0.87102,"scheduling_latency_s":0.871032,"redis_calls":16,"redis_duration_s":0.001903,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000185498,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013972,"completed_at":"2026-10-04T17:42:06.345Z","load_balancing_strategy":"primary","db_duration_s":0.000211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 157.578686] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"321a1870384416539061da4f","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-321a1870384416539061da4f: start","job_status":"start","queue_duration_s":0.885824,"scheduling_latency_s":0.885837}1357gitlab # [ 157.581269] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"321a1870384416539061da4f","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-321a1870384416539061da4f: done: 0.009022 sec","job_status":"done","queue_duration_s":0.885824,"scheduling_latency_s":0.885837,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009022,"completed_at":"2026-10-04T17:42:06.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 157.617313] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84c2a01824e4da3cd651589","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84c2a01824e4da3cd651589: start","job_status":"start","queue_duration_s":0.895678,"scheduling_latency_s":0.89569}1359gitlab # [ 157.660725] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84c2a01824e4da3cd651589","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84c2a01824e4da3cd651589: done: 0.009164 sec","job_status":"done","queue_duration_s":0.895678,"scheduling_latency_s":0.89569,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009164,"completed_at":"2026-10-04T17:42:06.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 157.663926] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6caee62074268ef2949420d3","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6caee62074268ef2949420d3: start","job_status":"start","queue_duration_s":0.905637,"scheduling_latency_s":0.905649}1361gitlab # [ 157.704665] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6caee62074268ef2949420d3","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6caee62074268ef2949420d3: done: 0.00883 sec","job_status":"done","queue_duration_s":0.905637,"scheduling_latency_s":0.905649,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00883,"completed_at":"2026-10-04T17:42:06.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 157.710498] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47fba619e41464d66b8ed350","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47fba619e41464d66b8ed350: start","job_status":"start","queue_duration_s":0.915268,"scheduling_latency_s":0.91528}1363gitlab # [ 157.758157] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47fba619e41464d66b8ed350","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47fba619e41464d66b8ed350: done: 0.008832 sec","job_status":"done","queue_duration_s":0.915268,"scheduling_latency_s":0.91528,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008832,"completed_at":"2026-10-04T17:42:06.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 157.759222] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8026053f9ee5f3899d261118","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8026053f9ee5f3899d261118: start","job_status":"start","queue_duration_s":0.924894,"scheduling_latency_s":0.924907}1365gitlab # [ 157.803693] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8026053f9ee5f3899d261118","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8026053f9ee5f3899d261118: done: 0.009598 sec","job_status":"done","queue_duration_s":0.924894,"scheduling_latency_s":0.924907,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009598,"completed_at":"2026-10-04T17:42:06.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 157.804620] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c269699ee7bacdc529906c69","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c269699ee7bacdc529906c69: start","job_status":"start","queue_duration_s":0.93528,"scheduling_latency_s":0.935293}1367gitlab # [ 157.815611] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c269699ee7bacdc529906c69","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c269699ee7bacdc529906c69: done: 0.009255 sec","job_status":"done","queue_duration_s":0.93528,"scheduling_latency_s":0.935293,"redis_calls":13,"redis_duration_s":0.00176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009255,"completed_at":"2026-10-04T17:42:06.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 157.873042] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c06eb910bd88fe9d89e0ed5","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c06eb910bd88fe9d89e0ed5: start","job_status":"start","queue_duration_s":0.945339,"scheduling_latency_s":0.945351}1369gitlab # [ 157.873659] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c06eb910bd88fe9d89e0ed5","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c06eb910bd88fe9d89e0ed5: done: 0.008906 sec","job_status":"done","queue_duration_s":0.945339,"scheduling_latency_s":0.945351,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008906,"completed_at":"2026-10-04T17:42:06.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 157.918682] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"807b26cf037979e43dce9ddf","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-807b26cf037979e43dce9ddf: start","job_status":"start","queue_duration_s":0.955029,"scheduling_latency_s":0.955041}1371gitlab # [ 157.919531] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"807b26cf037979e43dce9ddf","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-807b26cf037979e43dce9ddf: done: 0.008789 sec","job_status":"done","queue_duration_s":0.955029,"scheduling_latency_s":0.955041,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008789,"completed_at":"2026-10-04T17:42:06.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 157.976273] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2635911d5b2ea81d1813f52","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2635911d5b2ea81d1813f52: start","job_status":"start","queue_duration_s":0.964923,"scheduling_latency_s":0.964936}1373gitlab # [ 157.976929] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2635911d5b2ea81d1813f52","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2635911d5b2ea81d1813f52: done: 0.009401 sec","job_status":"done","queue_duration_s":0.964923,"scheduling_latency_s":0.964936,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-10-04T17:42:06.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 158.026491] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4eaf36e9940e306ca3607601","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4eaf36e9940e306ca3607601: start","job_status":"start","queue_duration_s":0.975121,"scheduling_latency_s":0.975133}1375gitlab # [ 158.026688] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4eaf36e9940e306ca3607601","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4eaf36e9940e306ca3607601: done: 0.009097 sec","job_status":"done","queue_duration_s":0.975121,"scheduling_latency_s":0.975133,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009097,"completed_at":"2026-10-04T17:42:06.444Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 158.074551] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b8bb311ce7c622a775362e1","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b8bb311ce7c622a775362e1: start","job_status":"start","queue_duration_s":0.985045,"scheduling_latency_s":0.985058}1377gitlab # [ 158.075212] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b8bb311ce7c622a775362e1","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b8bb311ce7c622a775362e1: done: 0.009077 sec","job_status":"done","queue_duration_s":0.985045,"scheduling_latency_s":0.985058,"redis_calls":13,"redis_duration_s":0.0015310000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009077,"completed_at":"2026-10-04T17:42:06.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 158.084026] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"875c905d99e51eb18c6c4f09","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-875c905d99e51eb18c6c4f09: start","job_status":"start","queue_duration_s":0.994926,"scheduling_latency_s":0.994938}1379gitlab # [ 158.124244] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"875c905d99e51eb18c6c4f09","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-875c905d99e51eb18c6c4f09: done: 0.00937 sec","job_status":"done","queue_duration_s":0.994926,"scheduling_latency_s":0.994938,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00937,"completed_at":"2026-10-04T17:42:06.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 158.130228] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e2c1a679b8a53cb8d283b07","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e2c1a679b8a53cb8d283b07: start","job_status":"start","queue_duration_s":1.005103,"scheduling_latency_s":1.005115}1381gitlab # [ 158.168900] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e2c1a679b8a53cb8d283b07","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e2c1a679b8a53cb8d283b07: done: 0.009108 sec","job_status":"done","queue_duration_s":1.005103,"scheduling_latency_s":1.005115,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009108,"completed_at":"2026-10-04T17:42:06.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 158.208520] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25aecaa57acd8b8a19b7be83","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25aecaa57acd8b8a19b7be83: start","job_status":"start","queue_duration_s":1.015002,"scheduling_latency_s":1.015014}1383gitlab # [ 158.208707] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25aecaa57acd8b8a19b7be83","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25aecaa57acd8b8a19b7be83: done: 0.008805 sec","job_status":"done","queue_duration_s":1.015002,"scheduling_latency_s":1.015014,"redis_calls":13,"redis_duration_s":0.001724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008805,"completed_at":"2026-10-04T17:42:06.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 158.250820] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91a62bdd7893a0152ae0eddd","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91a62bdd7893a0152ae0eddd: start","job_status":"start","queue_duration_s":1.024581,"scheduling_latency_s":1.024593}1385gitlab # [ 158.251611] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91a62bdd7893a0152ae0eddd","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91a62bdd7893a0152ae0eddd: done: 0.009143 sec","job_status":"done","queue_duration_s":1.024581,"scheduling_latency_s":1.024593,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009143,"completed_at":"2026-10-04T17:42:06.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 158.269577] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccffb5b0d9b8a8eabcec8360","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccffb5b0d9b8a8eabcec8360: start","job_status":"start","queue_duration_s":1.03487,"scheduling_latency_s":1.034884}1387gitlab # [ 158.281091] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccffb5b0d9b8a8eabcec8360","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccffb5b0d9b8a8eabcec8360: done: 0.009254 sec","job_status":"done","queue_duration_s":1.03487,"scheduling_latency_s":1.034884,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009254,"completed_at":"2026-10-04T17:42:06.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 158.323694] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecc78494f36bcf431fbfc533","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecc78494f36bcf431fbfc533: start","job_status":"start","queue_duration_s":1.044947,"scheduling_latency_s":1.04496}1389gitlab # [ 158.327594] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecc78494f36bcf431fbfc533","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecc78494f36bcf431fbfc533: done: 0.009177 sec","job_status":"done","queue_duration_s":1.044947,"scheduling_latency_s":1.04496,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009177,"completed_at":"2026-10-04T17:42:06.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 158.371831] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c43b30e475942079921da5d5","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c43b30e475942079921da5d5: start","job_status":"start","queue_duration_s":1.054955,"scheduling_latency_s":1.054967}1391gitlab # [ 158.374315] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c43b30e475942079921da5d5","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c43b30e475942079921da5d5: done: 0.009055 sec","job_status":"done","queue_duration_s":1.054955,"scheduling_latency_s":1.054967,"redis_calls":13,"redis_duration_s":0.0015830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009055,"completed_at":"2026-10-04T17:42:06.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 158.427968] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d45db25d8bc05d83d8938625","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d45db25d8bc05d83d8938625: start","job_status":"start","queue_duration_s":1.064819,"scheduling_latency_s":1.064831}1393gitlab # [ 158.428808] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d45db25d8bc05d83d8938625","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d45db25d8bc05d83d8938625: done: 0.009469 sec","job_status":"done","queue_duration_s":1.064819,"scheduling_latency_s":1.064831,"redis_calls":13,"redis_duration_s":0.001603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009469,"completed_at":"2026-10-04T17:42:06.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 158.495729] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4afa0f8dae913605538a3845","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4afa0f8dae913605538a3845: start","job_status":"start","queue_duration_s":1.075085,"scheduling_latency_s":1.075097}1395gitlab # [ 158.496769] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4afa0f8dae913605538a3845","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4afa0f8dae913605538a3845: done: 0.008989 sec","job_status":"done","queue_duration_s":1.075085,"scheduling_latency_s":1.075097,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008989,"completed_at":"2026-10-04T17:42:06.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 158.506694] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d25ba30f77cb1e6a457dd1","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d25ba30f77cb1e6a457dd1: start","job_status":"start","queue_duration_s":1.084873,"scheduling_latency_s":1.084886}1397gitlab # [ 158.518752] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d25ba30f77cb1e6a457dd1","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d25ba30f77cb1e6a457dd1: done: 0.008957 sec","job_status":"done","queue_duration_s":1.084873,"scheduling_latency_s":1.084886,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008957,"completed_at":"2026-10-04T17:42:06.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 158.571699] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dfb37162c41af6df544a530","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dfb37162c41af6df544a530: start","job_status":"start","queue_duration_s":1.094601,"scheduling_latency_s":1.094614}1399gitlab # [ 158.572621] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dfb37162c41af6df544a530","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dfb37162c41af6df544a530: done: 0.008862 sec","job_status":"done","queue_duration_s":1.094601,"scheduling_latency_s":1.094614,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008862,"completed_at":"2026-10-04T17:42:06.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 158.616814] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a309d27c5a731b32cfb39e6","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a309d27c5a731b32cfb39e6: start","job_status":"start","queue_duration_s":1.104568,"scheduling_latency_s":1.104581}1401gitlab # [ 158.617771] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a309d27c5a731b32cfb39e6","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a309d27c5a731b32cfb39e6: done: 0.009003 sec","job_status":"done","queue_duration_s":1.104568,"scheduling_latency_s":1.104581,"redis_calls":13,"redis_duration_s":0.001561,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009003,"completed_at":"2026-10-04T17:42:06.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 158.682833] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40c14b0116ff2a4be5065938","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40c14b0116ff2a4be5065938: start","job_status":"start","queue_duration_s":1.114388,"scheduling_latency_s":1.1144}1403gitlab # [ 158.683762] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40c14b0116ff2a4be5065938","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40c14b0116ff2a4be5065938: done: 0.008817 sec","job_status":"done","queue_duration_s":1.114388,"scheduling_latency_s":1.1144,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008817,"completed_at":"2026-10-04T17:42:06.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 158.697629] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1839b3204aa959dbbbc9c0","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1839b3204aa959dbbbc9c0: start","job_status":"start","queue_duration_s":1.12397,"scheduling_latency_s":1.123983}1405gitlab # [ 158.709717] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1839b3204aa959dbbbc9c0","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1839b3204aa959dbbbc9c0: done: 0.011388 sec","job_status":"done","queue_duration_s":1.12397,"scheduling_latency_s":1.123983,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011388,"completed_at":"2026-10-04T17:42:06.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 158.762146] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1b02eda62ef42bc6cbe1320","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1b02eda62ef42bc6cbe1320: start","job_status":"start","queue_duration_s":1.136375,"scheduling_latency_s":1.136395}1407gitlab # [ 158.762965] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1b02eda62ef42bc6cbe1320","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1b02eda62ef42bc6cbe1320: done: 0.009826 sec","job_status":"done","queue_duration_s":1.136375,"scheduling_latency_s":1.136395,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009826,"completed_at":"2026-10-04T17:42:06.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 158.805610] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af3574e2d0db0971633d7262","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af3574e2d0db0971633d7262: start","job_status":"start","queue_duration_s":1.147216,"scheduling_latency_s":1.147229}1409gitlab # [ 158.806623] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af3574e2d0db0971633d7262","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af3574e2d0db0971633d7262: done: 0.01381 sec","job_status":"done","queue_duration_s":1.147216,"scheduling_latency_s":1.147229,"redis_calls":13,"redis_duration_s":0.0015860000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01381,"completed_at":"2026-10-04T17:42:06.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 158.847329] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59f01727ba38c2e6d996c7b","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59f01727ba38c2e6d996c7b: start","job_status":"start","queue_duration_s":1.161931,"scheduling_latency_s":1.161945}1411gitlab # [ 158.850702] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59f01727ba38c2e6d996c7b","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59f01727ba38c2e6d996c7b: done: 0.010543 sec","job_status":"done","queue_duration_s":1.161931,"scheduling_latency_s":1.161945,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010543,"completed_at":"2026-10-04T17:42:06.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 158.902631] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3522041723862575b4dacad6","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3522041723862575b4dacad6: start","job_status":"start","queue_duration_s":1.173291,"scheduling_latency_s":1.173304}1413gitlab # [ 158.903742] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3522041723862575b4dacad6","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3522041723862575b4dacad6: done: 0.008599 sec","job_status":"done","queue_duration_s":1.173291,"scheduling_latency_s":1.173304,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008599,"completed_at":"2026-10-04T17:42:06.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 158.972553] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1331ab24c2bcbce854001b2c","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1331ab24c2bcbce854001b2c: start","job_status":"start","queue_duration_s":1.182654,"scheduling_latency_s":1.182666}1415gitlab # [ 158.973526] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1331ab24c2bcbce854001b2c","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1331ab24c2bcbce854001b2c: done: 0.008527 sec","job_status":"done","queue_duration_s":1.182654,"scheduling_latency_s":1.182666,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008527,"completed_at":"2026-10-04T17:42:06.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 159.014591] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24250c2e2d0bb8822c461494","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24250c2e2d0bb8822c461494: start","job_status":"start","queue_duration_s":1.192134,"scheduling_latency_s":1.192147}1417gitlab # [ 159.015646] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24250c2e2d0bb8822c461494","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24250c2e2d0bb8822c461494: done: 0.008467 sec","job_status":"done","queue_duration_s":1.192134,"scheduling_latency_s":1.192147,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008467,"completed_at":"2026-10-04T17:42:06.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 159.029505] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4fd0128dcff251f48ed14cb","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4fd0128dcff251f48ed14cb: start","job_status":"start","queue_duration_s":1.201398,"scheduling_latency_s":1.20141}1419gitlab # [ 159.041290] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4fd0128dcff251f48ed14cb","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4fd0128dcff251f48ed14cb: done: 0.008741 sec","job_status":"done","queue_duration_s":1.201398,"scheduling_latency_s":1.20141,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008741,"completed_at":"2026-10-04T17:42:06.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 159.114509] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4c02362536b5874544fe24","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4c02362536b5874544fe24: start","job_status":"start","queue_duration_s":1.210963,"scheduling_latency_s":1.210976}1421gitlab # [ 159.115158] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4c02362536b5874544fe24","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4c02362536b5874544fe24: done: 0.008537 sec","job_status":"done","queue_duration_s":1.210963,"scheduling_latency_s":1.210976,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008537,"completed_at":"2026-10-04T17:42:06.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 159.123974] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee8d9230a832583c85e1b057","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee8d9230a832583c85e1b057: start","job_status":"start","queue_duration_s":1.220306,"scheduling_latency_s":1.220318}1423gitlab # [ 159.135420] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee8d9230a832583c85e1b057","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee8d9230a832583c85e1b057: done: 0.008626 sec","job_status":"done","queue_duration_s":1.220306,"scheduling_latency_s":1.220318,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008626,"completed_at":"2026-10-04T17:42:06.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 159.201089] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b18ccf7656e2490d6aa73774","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b18ccf7656e2490d6aa73774: start","job_status":"start","queue_duration_s":1.229692,"scheduling_latency_s":1.229704}1425gitlab # [ 159.201843] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b18ccf7656e2490d6aa73774","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b18ccf7656e2490d6aa73774: done: 0.008579 sec","job_status":"done","queue_duration_s":1.229692,"scheduling_latency_s":1.229704,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008579,"completed_at":"2026-10-04T17:42:06.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 159.248842] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd24709092e1f91c39679b0f","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd24709092e1f91c39679b0f: start","job_status":"start","queue_duration_s":1.239109,"scheduling_latency_s":1.239123}1427gitlab # [ 159.249601] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd24709092e1f91c39679b0f","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd24709092e1f91c39679b0f: done: 0.008742 sec","job_status":"done","queue_duration_s":1.239109,"scheduling_latency_s":1.239123,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008742,"completed_at":"2026-10-04T17:42:06.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 159.259603] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dad884ea4a29d1738be751fa","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dad884ea4a29d1738be751fa: start","job_status":"start","queue_duration_s":1.248671,"scheduling_latency_s":1.248684}1429gitlab # [ 159.270783] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dad884ea4a29d1738be751fa","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dad884ea4a29d1738be751fa: done: 0.008804 sec","job_status":"done","queue_duration_s":1.248671,"scheduling_latency_s":1.248684,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008804,"completed_at":"2026-10-04T17:42:06.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 159.309412] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2b3946560ba375e4424c896","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2b3946560ba375e4424c896: start","job_status":"start","queue_duration_s":1.258414,"scheduling_latency_s":1.258427}1431gitlab # [ 159.348195] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2b3946560ba375e4424c896","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2b3946560ba375e4424c896: done: 0.008797 sec","job_status":"done","queue_duration_s":1.258414,"scheduling_latency_s":1.258427,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008797,"completed_at":"2026-10-04T17:42:06.727Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 159.349216] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5895e22cc1cb632db013eab3","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5895e22cc1cb632db013eab3: start","job_status":"start","queue_duration_s":1.26804,"scheduling_latency_s":1.268053}1433gitlab # [ 159.393833] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5895e22cc1cb632db013eab3","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5895e22cc1cb632db013eab3: done: 0.008787 sec","job_status":"done","queue_duration_s":1.26804,"scheduling_latency_s":1.268053,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008787,"completed_at":"2026-10-04T17:42:06.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 159.395156] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b9d612bf151a70f374e0e0f","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b9d612bf151a70f374e0e0f: start","job_status":"start","queue_duration_s":1.277579,"scheduling_latency_s":1.277591}1435gitlab # [ 159.405711] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b9d612bf151a70f374e0e0f","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b9d612bf151a70f374e0e0f: done: 0.009191 sec","job_status":"done","queue_duration_s":1.277579,"scheduling_latency_s":1.277591,"redis_calls":13,"redis_duration_s":0.00202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009191,"completed_at":"2026-10-04T17:42:06.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 159.441394] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"402d609fd597b1138a0f91b3","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-402d609fd597b1138a0f91b3: start","job_status":"start","queue_duration_s":1.287676,"scheduling_latency_s":1.287688}1437gitlab # [ 159.489138] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"402d609fd597b1138a0f91b3","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-402d609fd597b1138a0f91b3: done: 0.01171 sec","job_status":"done","queue_duration_s":1.287676,"scheduling_latency_s":1.287688,"redis_calls":13,"redis_duration_s":0.004441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01171,"completed_at":"2026-10-04T17:42:06.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 159.490134] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"312e317253489bfbbb2e1c35","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-312e317253489bfbbb2e1c35: start","job_status":"start","queue_duration_s":1.300321,"scheduling_latency_s":1.300333}1439gitlab # [ 159.496854] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"312e317253489bfbbb2e1c35","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-312e317253489bfbbb2e1c35: done: 0.008749 sec","job_status":"done","queue_duration_s":1.300321,"scheduling_latency_s":1.300333,"redis_calls":13,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008749,"completed_at":"2026-10-04T17:42:06.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 159.531770] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dbce9f264c7f563f7f7ffa7","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dbce9f264c7f563f7f7ffa7: start","job_status":"start","queue_duration_s":1.309864,"scheduling_latency_s":1.309877}1441gitlab # [ 159.578126] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dbce9f264c7f563f7f7ffa7","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dbce9f264c7f563f7f7ffa7: done: 0.008677 sec","job_status":"done","queue_duration_s":1.309864,"scheduling_latency_s":1.309877,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008677,"completed_at":"2026-10-04T17:42:06.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 159.579533] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1f13ce34cf716e9aab8ca88","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1f13ce34cf716e9aab8ca88: start","job_status":"start","queue_duration_s":1.319373,"scheduling_latency_s":1.319386}1443gitlab # [ 159.587981] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1f13ce34cf716e9aab8ca88","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1f13ce34cf716e9aab8ca88: done: 0.008951 sec","job_status":"done","queue_duration_s":1.319373,"scheduling_latency_s":1.319386,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008951,"completed_at":"2026-10-04T17:42:06.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 159.648777] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eff370ca4ff41be602ace818","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eff370ca4ff41be602ace818: start","job_status":"start","queue_duration_s":1.329111,"scheduling_latency_s":1.329123}1445gitlab # [ 159.649784] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eff370ca4ff41be602ace818","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eff370ca4ff41be602ace818: done: 0.008654 sec","job_status":"done","queue_duration_s":1.329111,"scheduling_latency_s":1.329123,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008654,"completed_at":"2026-10-04T17:42:06.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 159.690242] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35430c4695862922b7e6ab05","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35430c4695862922b7e6ab05: start","job_status":"start","queue_duration_s":1.338627,"scheduling_latency_s":1.33864}1447gitlab # [ 159.690845] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35430c4695862922b7e6ab05","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35430c4695862922b7e6ab05: done: 0.008831 sec","job_status":"done","queue_duration_s":1.338627,"scheduling_latency_s":1.33864,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008831,"completed_at":"2026-10-04T17:42:06.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 159.734864] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f24969b789e7c2e6e22f3861","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f24969b789e7c2e6e22f3861: start","job_status":"start","queue_duration_s":1.34831,"scheduling_latency_s":1.348322}1449gitlab # [ 159.735714] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f24969b789e7c2e6e22f3861","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f24969b789e7c2e6e22f3861: done: 0.008572 sec","job_status":"done","queue_duration_s":1.34831,"scheduling_latency_s":1.348322,"redis_calls":13,"redis_duration_s":0.0015339999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008572,"completed_at":"2026-10-04T17:42:06.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 159.759862] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbfedecab037d16739f7ab3a","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbfedecab037d16739f7ab3a: start","job_status":"start","queue_duration_s":1.357649,"scheduling_latency_s":1.357662}1451gitlab # [ 159.799853] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbfedecab037d16739f7ab3a","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbfedecab037d16739f7ab3a: done: 0.008526 sec","job_status":"done","queue_duration_s":1.357649,"scheduling_latency_s":1.357662,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008526,"completed_at":"2026-10-04T17:42:06.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 159.804488] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd8d28d7bc9a0946708ff707","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd8d28d7bc9a0946708ff707: start","job_status":"start","queue_duration_s":1.367009,"scheduling_latency_s":1.367021}1453gitlab # [ 159.816243] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd8d28d7bc9a0946708ff707","created_at":"2026-10-04T17:42:05.318Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-73e08eab2a79463d","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f425bfd028ce53ff53bc801fb8ba08f6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.460Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd8d28d7bc9a0946708ff707: done: 0.008487 sec","job_status":"done","queue_duration_s":1.367009,"scheduling_latency_s":1.367021,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008487,"completed_at":"2026-10-04T17:42:06.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 159.869509] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0448cbcd8614aed7f9501090","created_at":"2026-10-04T17:42:05.465Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10aefff4c4342b3646cd870a61346715","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.544Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0448cbcd8614aed7f9501090: start","job_status":"start","queue_duration_s":1.292152,"scheduling_latency_s":1.292165}1455gitlab # [ 159.870179] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0448cbcd8614aed7f9501090","created_at":"2026-10-04T17:42:05.465Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-6d8e99edee4341d8","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10aefff4c4342b3646cd870a61346715","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.544Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0448cbcd8614aed7f9501090: done: 0.134945 sec","job_status":"done","queue_duration_s":1.292152,"scheduling_latency_s":1.292165,"redis_calls":14,"redis_duration_s":0.002148,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000804,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000305904,"exclusive_lock_hold_duration_s":0.116981069,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.134945,"completed_at":"2026-10-04T17:42:06.971Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 159.903054] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.977Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"34ce1ee182b55e78bcff9c05","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-34ce1ee182b55e78bcff9c05: start","job_status":"start","queue_duration_s":1.19294,"scheduling_latency_s":1.192956}1457gitlab # [ 159.913710] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.987Z","message":"No existing merge request to be cleaned up."}1458gitlab # [ 159.914662] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.995Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"34ce1ee182b55e78bcff9c05","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-34ce1ee182b55e78bcff9c05: done: 0.017625 sec","job_status":"done","queue_duration_s":1.19294,"scheduling_latency_s":1.192956,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00033,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196673,"duration_s":0.017625,"completed_at":"2026-10-04T17:42:06.995Z","load_balancing_strategy":"primary","db_duration_s":0.002252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 159.972274] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:06.995Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"69036f6ed53d98eaec576830","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-69036f6ed53d98eaec576830: start","job_status":"start","queue_duration_s":1.211384,"scheduling_latency_s":1.211396}1460gitlab # [ 159.972831] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.002Z","message":"No existing merge request to be cleaned up."}1461gitlab # [ 159.973505] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.008Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"69036f6ed53d98eaec576830","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-69036f6ed53d98eaec576830: done: 0.01265 sec","job_status":"done","queue_duration_s":1.211384,"scheduling_latency_s":1.211396,"redis_calls":10,"redis_duration_s":0.002073,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01265,"completed_at":"2026-10-04T17:42:07.008Z","load_balancing_strategy":"primary","db_duration_s":0.001382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 160.025043] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.009Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ed99d2b43b85000bb7c7b4fb","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ed99d2b43b85000bb7c7b4fb: start","job_status":"start","queue_duration_s":1.224868,"scheduling_latency_s":1.224881}1463gitlab # [ 160.025742] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.015Z","message":"No existing merge request to be cleaned up."}1464gitlab # [ 160.026263] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.020Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ed99d2b43b85000bb7c7b4fb","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ed99d2b43b85000bb7c7b4fb: done: 0.011246 sec","job_status":"done","queue_duration_s":1.224868,"scheduling_latency_s":1.224881,"redis_calls":10,"redis_duration_s":0.0012950000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011246,"completed_at":"2026-10-04T17:42:07.020Z","load_balancing_strategy":"primary","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 160.042604] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.021Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f84d40524de1d1e34cf74995","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f84d40524de1d1e34cf74995: start","job_status":"start","queue_duration_s":1.236936,"scheduling_latency_s":1.236948}1466gitlab # [ 160.053621] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.029Z","message":"No existing merge request to be cleaned up."}1467gitlab # [ 160.055071] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:07.033Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f84d40524de1d1e34cf74995","created_at":"2026-10-04T17:42:05.758Z","trace_propagation_headers":{"sentry-trace":"302c419cd0604ca391a169925d1a7a73-1df993aaaf92458a","baggage":"sentry-trace_id=302c419cd0604ca391a169925d1a7a73,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6dcd70187e37feaea8d291205651c0d8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:05.784Z","job_size_bytes":2,"pid":1599,"sidekiq_tid":"magb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f84d40524de1d1e34cf74995: done: 0.012454 sec","job_status":"done","queue_duration_s":1.236936,"scheduling_latency_s":1.236948,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012454,"completed_at":"2026-10-04T17:42:07.033Z","load_balancing_strategy":"primary","db_duration_s":0.002028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 160.274009] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1882980712 wd_nsec: 18829806451469gitlab # [ 175.198344] postgres[2381]: [2381] ERROR: relation "table_without_models" does not exist1470gitlab # [ 175.200687] postgres[2381]: [2381] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1471gitlab # [ 178.150084] runuser[2190]: pam_unix(runuser:session): session closed for user gitlab1472gitlab # [ 178.151576] setup-gitlab-start[2166]: + systemctl restart gitlab-sidekiq.service1473gitlab # [ 178.180309] systemd[1]: Stopping gitlab-sidekiq.service...1474gitlab # [ 178.181673] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:27.444Z","message":"Shutting down"}1475gitlab # [ 178.182678] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:27.444Z","message":"Scheduler exiting..."}1476gitlab # [ 178.183800] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:27.444Z","message":"Terminating quiet threads for default capsule"}1477gitlab # [ 178.184909] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:27.445Z","message":"Scheduler exiting..."}1478gitlab # [ 178.682294] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:27.946Z","message":"Pausing to allow jobs to finish..."}1479gitlab # [ 183.187437] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:32.450Z","message":"Bye!"}1480gitlab # [ 183.208303] sidekiq-cluster[1599]: {"severity":"INFO","time":"2026-10-04T17:42:32.472Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1599,"worker_id":"sidekiq_0","memwd_rss_bytes":937689088,"retry":0}1481gitlab # [ 184.072087] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1482gitlab # [ 184.074715] systemd[1]: Stopped gitlab-sidekiq.service.1483gitlab # [ 184.076391] systemd[1]: gitlab-sidekiq.service: Consumed 53.780s CPU time over 1min 52.893s wall clock time, 955.6M memory peak, 4.3M read from disk.1484gitlab # [ 184.084444] systemd[1]: Started gitlab-sidekiq.service.1485gitlab # [ 184.090358] setup-gitlab-start[2166]: + mkdir -p /var/lib/secrets1486gitlab # [ 184.093492] setup-gitlab-start[2166]: + echo nixbot-test-token-of-20-chars1487gitlab # [ 184.095426] setup-gitlab-start[2166]: + chmod 644 /var/lib/secrets/gitlab-token1488gitlab # [ 184.097284] setup-gitlab-start[2166]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1489gitlab # [ 184.579724] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:33 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 4561490gitlab # [ 185.076544] gitaly[893]: time="2026-10-04T17:42:34.340Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.339" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 185.093991] gitaly[893]: time="2026-10-04T17:42:34.340Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.339" grpc.time_ms=0.404 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 185.164893] gitaly[893]: time="2026-10-04T17:42:34.428Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.098" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.428" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 185.183827] gitaly[893]: time="2026-10-04T17:42:34.429Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.098" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.428" grpc.time_ms=0.285 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 185.234470] gitaly[893]: time="2026-10-04T17:42:34.498Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV diskcache=961849e5-425c-45fe-9f0e-fdd90ec3d015 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T17:42:44.121" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.451" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 185.250669] gitaly[893]: time="2026-10-04T17:42:34.514Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T17:42:44.121" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.451" grpc.time_ms=46.663 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 185.272171] gitaly[893]: time="2026-10-04T17:42:34.536Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.204" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.535" pid=893 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1497gitlab # [ 185.281794] gitaly[893]: time="2026-10-04T17:42:34.536Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.204" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.535" grpc.time_ms=0.769 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 185.306613] gitaly[893]: time="2026-10-04T17:42:34.570Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:42:44.230" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.560" grpc.time_ms=9.662 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 185.388124] gitaly[893]: time="2026-10-04T17:42:34.651Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.651" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 185.410797] gitaly[893]: time="2026-10-04T17:42:34.652Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.651" grpc.time_ms=0.332 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 185.434810] gitaly[893]: time="2026-10-04T17:42:34.698Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV diskcache=4c2bbf9d-51d8-41cd-b8cc-1db8296f08f6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T17:42:44.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.654" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1502gitlab # [ 185.447521] gitaly[893]: time="2026-10-04T17:42:34.699Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-04T17:42:44.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.654" grpc.time_ms=44.312 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1503gitlab # [ 185.448563] gitaly[893]: time="2026-10-04T17:42:34.704Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.054" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.704" pid=893 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1504gitlab # [ 185.449473] gitaly[893]: time="2026-10-04T17:42:34.704Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.054" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.704" grpc.time_ms=0.332 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1505gitlab # [ 185.480665] gitaly[893]: time="2026-10-04T17:42:34.744Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=1 command.system_time_ms=24 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:42:44.057" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.708" grpc.time_ms=36.387 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1506gitlab # [ 185.501313] gitaly[893]: time="2026-10-04T17:42:34.765Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:42:44.114" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.765" grpc.time_ms=0.213 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1507gitlab # [ 185.517508] gitaly[893]: time="2026-10-04T17:42:34.781Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T17:42:44.130" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:34.780" grpc.time_ms=0.264 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1508gitlab # [ 185.947982] gitaly[893]: time="2026-10-04T17:42:35.211Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44059M4VAZGDE22AQKGR9JV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:42:45.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:35.206" grpc.time_ms=5.44 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1509gitlab # [ 186.306618] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:35 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 17091510gitlab # [ 186.312509] setup-gitlab-start[2443]: {"id":1,"message":null,"error":null}1511gitlab # [ 187.196700] sidekiq-cluster[2431]: {"severity":"INFO","time":"2026-10-04T17:42:36.444Z","message":"Starting cluster with 1 processes"}1512gitlab # [ 191.447631] gitaly[893]: time="2026-10-04T17:42:40.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405G6SETRCJW3FBR5MA7S4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:42:50.052" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:40.702" grpc.time_ms=7.873 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1513gitlab # [ 191.484275] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:40 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1451514gitlab # [ 191.487402] setup-gitlab-start[2166]: + mkdir -p /tmp/test-flake1515gitlab # [ 191.488792] setup-gitlab-start[2166]: + cd /tmp/test-flake1516gitlab # [ 191.489842] setup-gitlab-start[2166]: + git init -b master1517gitlab # [ 191.509925] setup-gitlab-start[2517]: Initialized empty Git repository in /tmp/test-flake/.git/1518gitlab # [ 191.511195] setup-gitlab-start[2166]: + git config user.name test1519gitlab # [ 191.512302] setup-gitlab-start[2166]: + git config user.email test@example.com1520gitlab # [ 191.514712] setup-gitlab-start[2166]: + cat1521gitlab # [ 191.516882] setup-gitlab-start[2166]: + git add flake.nix1522gitlab # [ 191.519400] setup-gitlab-start[2166]: + git commit -m 'initial commit'1523gitlab # [ 191.535088] setup-gitlab-start[2522]: [master (root-commit) f86e523] initial commit1524gitlab # [ 191.536092] setup-gitlab-start[2522]: 1 file changed, 10 insertions(+)1525gitlab # [ 191.537281] setup-gitlab-start[2522]: create mode 100644 flake.nix1526gitlab # [ 191.538663] setup-gitlab-start[2166]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1527gitlab # [ 191.541856] setup-gitlab-start[2166]: + git push -u origin master1528gitlab # [ 191.587849] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 251529gitlab # [ 191.677899] gitaly[893]: time="2026-10-04T17:42:40.941Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4405GERWZDMRMPZ94CXJBFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:40.929" grpc.time_ms=11.872 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 191.708829] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1151531gitlab # [ 192.138281] gitaly[893]: time="2026-10-04T17:42:41.402Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:42:51.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:41.392" grpc.time_ms=9.5 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 192.200567] gitaly[893]: time="2026-10-04T17:42:41.464Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-04T17:43:11.052" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-04T17:42:41.453" grpc.time_ms=11.026 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 192.270763] gitaly[893]: time="2026-10-04T17:42:41.534Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4405GJSC506HNJK8GJ2CRH7 duration_ms=239ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/allowed"1534gitlab # [ 192.300883] gitaly[893]: time="2026-10-04T17:42:41.564Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4405GJSC506HNJK8GJ2CRH7 duration_ms=23ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/pre_receive"1535gitlab # [ 192.310300] gitaly[893]: time="2026-10-04T17:42:41.565Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:41.294" grpc.time_ms=270.408 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1536gitlab # [ 192.354412] gitaly[893]: time="2026-10-04T17:42:41.618Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:41.617" grpc.time_ms=0.463 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1537gitlab # [ 192.401728] gitaly[893]: time="2026-10-04T17:42:41.665Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:41.664" grpc.time_ms=0.672 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 192.430321] gitaly[893]: time="2026-10-04T17:42:41.694Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:41.693" grpc.time_ms=0.33 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 192.553722] gitaly[893]: time="2026-10-04T17:42:41.817Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:42:51.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:41.806" grpc.time_ms=10.006 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 192.611139] gitaly[893]: time="2026-10-04T17:42:41.875Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1565 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-04T17:42:51.049" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:41.850" grpc.time_ms=24.293 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 192.645124] gitaly[893]: time="2026-10-04T17:42:41.909Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4405GJSC506HNJK8GJ2CRH7 duration_ms=170ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/post_receive"1542gitlab # [ 192.650397] gitaly[893]: time="2026-10-04T17:42:41.909Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:41.737" grpc.time_ms=171.917 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1543gitlab # [ 192.673291] gitaly[893]: time="2026-10-04T17:42:41.937Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 diskcache=3b4ba640-4a4a-48b3-8213-d5a5fd2f5551 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:41.220" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1544gitlab # [ 192.673972] gitaly[893]: time="2026-10-04T17:42:41.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=206 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13422 command.oublock=32 command.real_time_ms=706 command.spawn_token_fork_ms=1 command.system_time_ms=142 command.user_time_ms=64 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:41.220" grpc.time_ms=716.729 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1545gitlab # [ 192.675035] gitlab-workhorse[826]: time="2026-10-04T17:42:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521546gitlab # [ 192.675435] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:41 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9531547gitlab # [ 192.697576] setup-gitlab-start[2526]: To http://gitlab/root/test-flake.git1548gitlab # [ 192.698616] setup-gitlab-start[2526]: * [new branch] master -> master1549gitlab # [ 192.702632] setup-gitlab-start[2526]: branch 'master' set up to track 'origin/master'.1550gitlab # [ 192.706202] systemd[1]: Finished setup-gitlab.service.1551gitlab # [ 192.708866] systemd[1]: Starting nixbot CI service...1552gitlab: (finished: waiting for unit setup-gitlab.service, in 193.72 seconds)1553gitlab: waiting for unit nixbot.service1554gitlab # [ 194.029769] nixbot[2612]: {"ts": "2026-10-04T17:42:43.293Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1555gitlab # [ 194.068724] nixbot[2612]: {"ts": "2026-10-04T17:42:43.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1556gitlab # [ 194.099335] nixbot[2612]: {"ts": "2026-10-04T17:42:43.363Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1557gitlab # [ 194.110060] nixbot[2612]: {"ts": "2026-10-04T17:42:43.373Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1558gitlab # [ 194.121543] nixbot[2612]: {"ts": "2026-10-04T17:42:43.385Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1559gitlab # [ 194.131112] nixbot[2612]: {"ts": "2026-10-04T17:42:43.394Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1560gitlab # [ 194.136591] nixbot[2612]: {"ts": "2026-10-04T17:42:43.398Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1561gitlab # [ 194.141596] nixbot[2612]: {"ts": "2026-10-04T17:42:43.401Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1562gitlab # [ 194.148636] nixbot[2612]: {"ts": "2026-10-04T17:42:43.412Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1563gitlab # [ 194.154885] nixbot[2612]: {"ts": "2026-10-04T17:42:43.418Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1564gitlab # [ 194.165177] nixbot[2612]: {"ts": "2026-10-04T17:42:43.429Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1565gitlab # [ 194.173208] nixbot[2612]: {"ts": "2026-10-04T17:42:43.437Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1566gitlab # [ 194.177628] nixbot[2612]: {"ts": "2026-10-04T17:42:43.441Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1567gitlab # [ 194.184227] nixbot[2612]: {"ts": "2026-10-04T17:42:43.448Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1568gitlab # [ 194.193114] nixbot[2612]: {"ts": "2026-10-04T17:42:43.457Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1569gitlab # [ 194.199871] nixbot[2612]: {"ts": "2026-10-04T17:42:43.463Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1570gitlab # [ 194.204126] nixbot[2612]: {"ts": "2026-10-04T17:42:43.466Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1571gitlab # [ 194.209223] nixbot[2612]: {"ts": "2026-10-04T17:42:43.473Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1572gitlab # [ 194.217493] nixbot[2612]: {"ts": "2026-10-04T17:42:43.481Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1573gitlab # [ 194.221921] nixbot[2612]: {"ts": "2026-10-04T17:42:43.485Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1574gitlab # [ 194.226784] nixbot[2612]: {"ts": "2026-10-04T17:42:43.490Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1575gitlab # [ 194.232942] nixbot[2612]: {"ts": "2026-10-04T17:42:43.496Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1576gitlab # [ 194.236911] nixbot[2612]: {"ts": "2026-10-04T17:42:43.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1577gitlab # [ 194.241251] nixbot[2612]: {"ts": "2026-10-04T17:42:43.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1578gitlab # [ 194.245341] nixbot[2612]: {"ts": "2026-10-04T17:42:43.509Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1579gitlab # [ 194.249658] nixbot[2612]: {"ts": "2026-10-04T17:42:43.513Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1580gitlab # [ 194.253812] nixbot[2612]: {"ts": "2026-10-04T17:42:43.517Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1581gitlab # [ 194.257827] nixbot[2612]: {"ts": "2026-10-04T17:42:43.521Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1582gitlab # [ 194.261708] nixbot[2612]: {"ts": "2026-10-04T17:42:43.525Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1583gitlab # [ 194.276155] nixbot[2612]: {"ts": "2026-10-04T17:42:43.540Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1584gitlab # [ 194.284377] nixbot[2612]: {"ts": "2026-10-04T17:42:43.548Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1585gitlab # [ 194.288770] nixbot[2612]: {"ts": "2026-10-04T17:42:43.552Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1586gitlab # [ 194.292813] nixbot[2612]: {"ts": "2026-10-04T17:42:43.556Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1587gitlab # [ 194.300064] nixbot[2612]: {"ts": "2026-10-04T17:42:43.563Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1588gitlab # [ 194.304356] nixbot[2612]: {"ts": "2026-10-04T17:42:43.568Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1589gitlab # [ 194.311690] nixbot[2612]: {"ts": "2026-10-04T17:42:43.575Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1590gitlab # [ 194.317738] nixbot[2612]: {"ts": "2026-10-04T17:42:43.581Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1591gitlab # [ 194.687518] nixbot[2612]: INFO: Started server process [2612]1592gitlab # [ 194.689916] nixbot[2612]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1593gitlab # [ 194.730115] nixbot[2612]: INFO: ::ffff:127.0.0.1:42870 - "GET /health HTTP/1.1" 200 OK1594gitlab # [ 194.735304] systemd[1]: Started nixbot CI service.1595gitlab # [ 194.736873] systemd[1]: Reached target Multi-User System.1596gitlab # [ 194.737826] systemd[1]: Startup finished in 1.110s (kernel) + 3.696s (initrd) + 3min 9.931s (userspace) = 3min 14.737s.1597gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1598gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1599gitlab # [ 195.197129] nixbot[2612]: INFO: ::ffff:127.0.0.1:42286 - "GET /health HTTP/1.1" 200 OK1600gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1601subtest: project discovered and webhook registered1602gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1603gitlab # [ 195.292420] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 591604gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1605gitlab # [ 195.315397] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5851606gitlab # [ 195.322582] nixbot[2612]: {"ts": "2026-10-04T17:42:44.586Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1607gitlab # [ 195.343842] nixbot[2612]: {"ts": "2026-10-04T17:42:44.607Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1608gitlab # [ 195.397531] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 451609gitlab # [ 195.398998] nixbot[2612]: {"ts": "2026-10-04T17:42:44.662Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1610gitlab # [ 195.400165] nixbot[2612]: {"ts": "2026-10-04T17:42:44.663Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1611gitlab # [ 195.539589] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1271612gitlab # [ 195.542647] nixbot[2612]: {"ts": "2026-10-04T17:42:44.806Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1613gitlab # [ 195.680842] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1301614gitlab # [ 195.683932] nixbot[2612]: {"ts": "2026-10-04T17:42:44.947Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1615gitlab # [ 195.755292] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 561616gitlab # [ 195.757243] nixbot[2612]: {"ts": "2026-10-04T17:42:45.017Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1617gitlab # [ 195.803894] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 381618gitlab # [ 195.808841] nixbot[2612]: {"ts": "2026-10-04T17:42:45.068Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1619gitlab # [ 195.856234] gitaly[893]: time="2026-10-04T17:42:45.119Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4405MJJ17AAA8KYCA2FGPJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-04T17:43:15.003" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:45.104" grpc.time_ms=14.869 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 195.895494] gitaly[893]: time="2026-10-04T17:42:45.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405MJJ17AAA8KYCA2FGPJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:15.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:42:45.158" grpc.time_ms=0.603 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 195.915169] gitaly[893]: time="2026-10-04T17:42:45.167Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4405MJJ17AAA8KYCA2FGPJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-04T17:42:55.001" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:42:45.161" grpc.time_ms=5.873 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 195.927414] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1131623gitlab # [ 195.928568] nixbot[2612]: {"ts": "2026-10-04T17:42:45.189Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1624gitlab # [ 196.006533] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 731625gitlab # [ 196.008079] nixbot[2612]: {"ts": "2026-10-04T17:42:45.271Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1626gitlab # [ 196.019411] nixbot[2612]: {"ts": "2026-10-04T17:42:45.283Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1627gitlab # [ 196.139628] gitaly[893]: time="2026-10-04T17:42:45.403Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405MVH4D26V4R6WSXXYN6R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.397" grpc.time_ms=6.405 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab # [ 196.169527] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 721629gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1630gitlab # [ 196.279372] gitaly[893]: time="2026-10-04T17:42:45.543Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4405MXZX2EWE90GZN4YXM0A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.531" pid=893 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1631gitlab # [ 196.301281] gitaly[893]: time="2026-10-04T17:42:45.565Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405MXZX2EWE90GZN4YXM0A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.531" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1632gitlab # [ 196.328923] gitaly[893]: time="2026-10-04T17:42:45.592Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405MXZX2EWE90GZN4YXM0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.531" grpc.time_ms=61.276 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1633gitlab # [ 196.348840] gitlab-workhorse[826]: time="2026-10-04T17:42:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131634gitlab # [ 196.350679] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1531635gitlab # [ 196.381221] gitaly[893]: time="2026-10-04T17:42:45.645Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4405N2Y6N3JYYETNETHMMF4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.634" pid=893 remote_ip="2001:db8:1::1" request_sha=7360c921dfae95e75ec63aea4966d602ab97f11c response_bytes=223 span.kind=server system=grpc1636gitlab # [ 196.392222] gitaly[893]: time="2026-10-04T17:42:45.645Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4405N2Y6N3JYYETNETHMMF4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.634" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1637gitlab # [ 196.405368] gitlab-workhorse[826]: time="2026-10-04T17:42:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231638gitlab # [ 196.407315] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 571639gitlab # [ 196.409618] gitaly[893]: time="2026-10-04T17:42:45.654Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4405N2Y6N3JYYETNETHMMF4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.634" grpc.time_ms=20.721 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1640gitlab # [ 196.480413] gitaly[893]: time="2026-10-04T17:42:45.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405N63B3M0XMGSW5AR4BGC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.738" grpc.time_ms=6.084 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1641gitlab # [ 196.482493] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 461642gitlab # [ 196.492048] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 1121643gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds)1644(finished: subtest: project discovered and webhook registered, in 1.30 seconds)1645subtest: push delivers the webhook1646gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1647gitlab # [ 196.536058] gitaly[893]: time="2026-10-04T17:42:45.800Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4405N801FKZE6V9MKKVA7RE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.794" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1648gitlab # [ 196.536818] gitaly[893]: time="2026-10-04T17:42:45.800Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405N801FKZE6V9MKKVA7RE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.794" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1649gitlab # [ 196.556933] gitaly[893]: time="2026-10-04T17:42:45.821Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405N801FKZE6V9MKKVA7RE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.794" grpc.time_ms=26.241 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1650gitlab # [ 196.569863] gitlab-workhorse[826]: time="2026-10-04T17:42:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671651gitlab # [ 196.570544] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 731652gitlab # [ 196.632382] gitaly[893]: time="2026-10-04T17:42:45.896Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405NB2H9ZAAQKS56YGJA3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.888" grpc.time_ms=8.239 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1653gitlab # [ 196.633414] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 381654gitlab # [ 196.696784] gitaly[893]: time="2026-10-04T17:42:45.960Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4405NCQE8V86AJCFWYMXPGT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.946" pid=893 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1655gitlab # [ 196.697922] gitaly[893]: time="2026-10-04T17:42:45.960Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NCQE8V86AJCFWYMXPGT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.946" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1656gitlab # [ 196.699618] gitaly[893]: time="2026-10-04T17:42:45.963Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NCQE8V86AJCFWYMXPGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:42:45.946" grpc.time_ms=14.29 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1657gitlab # [ 196.700671] gitlab-workhorse[826]: time="2026-10-04T17:42:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091658gitlab # [ 196.701549] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 521659gitlab # [ 196.832245] gitaly[893]: time="2026-10-04T17:42:46.096Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:16.095" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:42:46.095" grpc.time_ms=0.634 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 196.899658] gitaly[893]: time="2026-10-04T17:42:46.163Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-04T17:43:16.156" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:46.157" grpc.time_ms=6.265 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 196.944967] gitaly[893]: time="2026-10-04T17:42:46.209Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:42:56.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:46.201" grpc.time_ms=7.467 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1662gitlab # [ 196.984765] gitaly[893]: time="2026-10-04T17:42:46.248Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:42:56.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:46.239" grpc.time_ms=9.2 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 197.082786] gitaly[893]: time="2026-10-04T17:42:46.346Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T17:42:56.145" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:46.346" grpc.time_ms=0.312 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 197.117930] gitaly[893]: time="2026-10-04T17:42:46.381Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T17:42:56.170" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:46.371" grpc.time_ms=10.711 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 197.166159] gitaly[893]: time="2026-10-04T17:42:46.430Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:46.429" grpc.time_ms=0.479 pid=893 span.kind=server system=grpc1666gitlab # [ 197.215649] gitaly[893]: time="2026-10-04T17:42:46.479Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:42:46.478" grpc.time_ms=0.762 pid=893 span.kind=server system=grpc1667gitlab # [ 197.243603] gitaly[893]: time="2026-10-04T17:42:46.507Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F diskcache=fe5a536b-5b8f-49f4-9a0d-964be6eb93e2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T17:42:56.184" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:46.384" pid=893 ref=refs/keep-around/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 remote_ip="2001:db8:1::1" revision=f86e5237bc7eb58df9207963e6720fdd3be7b2c9 span.kind=server system=grpc username=root1668gitlab # [ 197.244659] gitaly[893]: time="2026-10-04T17:42:46.507Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5170 command.oublock=8 command.real_time_ms=111 command.spawn_token_fork_ms=0 command.system_time_ms=58 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T17:42:56.184" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:42:46.384" grpc.time_ms=123.104 pid=893 ref=refs/keep-around/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 remote_ip="2001:db8:1::1" revision=f86e5237bc7eb58df9207963e6720fdd3be7b2c9 span.kind=server system=grpc username=root1669gitlab # [ 197.248484] gitaly[893]: time="2026-10-04T17:42:46.512Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:16.111" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:42:46.511" grpc.time_ms=0.459 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670gitlab # [ 197.374619] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 6041671gitlab # [ 197.381420] nixbot[2612]: {"ts": "2026-10-04T17:42:46.644Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}1672gitlab # [ 197.398319] nixbot[2612]: {"ts": "2026-10-04T17:42:46.662Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f86e5237bc7e-0"}1673gitlab # [ 197.606949] nixbot[2612]: {"ts": "2026-10-04T17:42:46.870Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f86e5237bc7e-0", "argv0": "bwrap"}1674gitlab # [ 197.701748] systemd[1]: Started Nix Daemon.1675gitlab # [ 197.772823] nix-daemon[2777]: accepted connection from pid 2772, user nixbot1676gitlab # [ 202.392396] nix-daemon[2777]: accepted connection from pid 2819, user nixbot1677gitlab # [ 202.410708] nix-daemon[2777]: accepted connection from pid 2772, user nixbot1678gitlab # [ 207.362107] nix-daemon[2777]: accepted connection from pid 2772, user nixbot1679gitlab # [ 207.455857] nix-daemon[2777]: accepted connection from pid 2868, user nixbot1680gitlab # [ 207.505167] gitaly[893]: time="2026-10-04T17:42:56.768Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405ZXZTXVD2VBXVSNP5FCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:26.664" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:42:56.764" grpc.time_ms=3.425 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 207.594819] gitaly[893]: time="2026-10-04T17:42:56.858Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405ZXZTXVD2VBXVSNP5FCR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:06.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:56.847" grpc.time_ms=10.986 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 207.685302] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2441683gitlab # [ 207.687778] nixbot[2612]: {"ts": "2026-10-04T17:42:56.949Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}1684gitlab # [ 207.731094] gitaly[893]: time="2026-10-04T17:42:56.995Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M440605RZ6PRE0ZDPC5TMZ8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:26.893" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:42:56.994" grpc.time_ms=0.668 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 207.790461] gitaly[893]: time="2026-10-04T17:42:57.054Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M440605RZ6PRE0ZDPC5TMZ8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:07.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:42:57.045" grpc.time_ms=8.245 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686gitlab # [ 207.836605] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:42:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1481687gitlab # [ 207.843521] nixbot[2612]: {"ts": "2026-10-04T17:42:57.107Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}1688gitlab # [ 210.613521] sidekiq-cluster[2488]: 2026-10-04T17:42:59.876Z pid=2488 tid=xsg INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2488, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435994624}1689gitlab # [ 210.771495] sidekiq-cluster[2488]: W, [2026-10-04T17:43:00.035335 #2488] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1690gitlab # [ 210.807251] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:00.071Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1691gitlab # [ 212.133759] nix-daemon[2777]: accepted connection from pid 2946, user nixbot1692gitlab # [ 212.205891] gitaly[893]: time="2026-10-04T17:43:01.469Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44064HM3XSQEC9M7M034SA8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:31.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:01.468" grpc.time_ms=0.751 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1693gitlab # [ 212.249964] gitaly[893]: time="2026-10-04T17:43:01.513Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M44064HM3XSQEC9M7M034SA8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:11.116" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:01.507" grpc.time_ms=5.909 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1694gitlab # [ 212.289921] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1251695gitlab # [ 212.295739] nixbot[2612]: {"ts": "2026-10-04T17:43:01.559Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}1696gitlab # [ 212.437938] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:01.701Z","message":"GitLab reliable fetch activated!"}1697gitlab # [ 212.438726] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:01.701Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1698gitlab # [ 212.594545] gitaly[893]: time="2026-10-04T17:43:01.858Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M44064XCEF14CH2GD37TFRYH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:01.852" grpc.time_ms=6.533 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1699gitlab # [ 212.606576] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 541700gitlab # [ 212.637169] gitaly[893]: time="2026-10-04T17:43:01.901Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M44064Z5GR61FCP6ANC9TD50 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:01.895" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1701gitlab # [ 212.647091] gitaly[893]: time="2026-10-04T17:43:01.901Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M44064Z5GR61FCP6ANC9TD50 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:01.895" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1702gitlab # [ 212.659442] gitlab-workhorse[826]: time="2026-10-04T17:43:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671703gitlab # [ 212.661267] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 401704gitlab # [ 212.663158] gitaly[893]: time="2026-10-04T17:43:01.901Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M44064Z5GR61FCP6ANC9TD50 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:01.895" grpc.time_ms=6.278 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1705gitlab # [ 212.713798] gitaly[893]: time="2026-10-04T17:43:01.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M440651KXEZSBDS2NZRH5MXX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:01.972" grpc.time_ms=5.676 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1706gitlab # [ 212.725640] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 381707gitlab # [ 212.760847] gitaly[893]: time="2026-10-04T17:43:02.024Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M440652VCFSSHVEKKZCH1VZQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:02.018" pid=893 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1708gitlab # [ 212.761593] gitaly[893]: time="2026-10-04T17:43:02.024Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M440652VCFSSHVEKKZCH1VZQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:02.018" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1709gitlab # [ 212.781935] gitaly[893]: time="2026-10-04T17:43:02.046Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M440652VCFSSHVEKKZCH1VZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:02.018" grpc.time_ms=27.499 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1710gitlab # [ 212.794929] gitlab-workhorse[826]: time="2026-10-04T17:43:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671711gitlab # [ 212.795551] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 791712gitlab # [ 230.686630] postgres[3137]: [3137] ERROR: relation "table_without_models" does not exist1713gitlab # [ 230.688320] postgres[3137]: [3137] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1714gitlab # [ 233.045680] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:22.308Z","message":"Booted Rails 7.2.3.1 application in production environment"}1715gitlab # [ 233.047074] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:22.309Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1716gitlab # [ 233.047812] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:22.309Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1717gitlab # [ 233.048429] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:22.309Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1718gitlab # [ 233.053919] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:22.317Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1719gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 37.28 seconds)1720gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1721gitlab # [ 233.867150] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:23 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 301722gitlab # [ 233.928967] gitaly[893]: time="2026-10-04T17:43:23.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4406SR0WGNTQH6QK8GE4NFF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:23.181" grpc.time_ms=10.646 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1723gitlab # [ 233.957797] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:23 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 571724gitlab # Enumerating objects: 5, done.1725gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1726gitlab # Delta compression using up to 4 threads1727gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1728gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1729gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1730gitlab # [ 234.164211] gitaly[893]: time="2026-10-04T17:43:23.428Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=333 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-04T17:43:53.014" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-04T17:43:23.415" grpc.time_ms=12.844 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 234.193956] gitaly[893]: time="2026-10-04T17:43:23.437Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4406SV7VY675V7SEBY9NYHZ duration_ms=61ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/allowed"1732gitlab # [ 234.199157] gitaly[893]: time="2026-10-04T17:43:23.456Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4406SV7VY675V7SEBY9NYHZ duration_ms=18ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/pre_receive"1733gitlab # [ 234.204262] gitaly[893]: time="2026-10-04T17:43:23.456Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:23.374" grpc.time_ms=81.65 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1734gitlab # [ 234.238572] gitaly[893]: time="2026-10-04T17:43:23.502Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:23.500" grpc.time_ms=1.549 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab # [ 234.279343] gitaly[893]: time="2026-10-04T17:43:23.543Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:23.542" grpc.time_ms=0.303 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1736gitlab # [ 234.306088] gitaly[893]: time="2026-10-04T17:43:23.570Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:23.569" grpc.time_ms=0.26 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1737gitlab # [ 234.312163] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.575Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1ab000e04be570ac54e25ded","created_at":"2026-10-04T17:42:34.594Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:34.629Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1ab000e04be570ac54e25ded: start","job_status":"start","queue_duration_s":48.946194,"scheduling_latency_s":48.946234}1738gitlab # [ 234.379556] gitaly[893]: time="2026-10-04T17:43:23.643Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4406SV7VY675V7SEBY9NYHZ duration_ms=33ns method=POST pid=893 status=200 url="http://unix/api/v4/internal/post_receive"1739gitlab # [ 234.382419] gitaly[893]: time="2026-10-04T17:43:23.646Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:23.609" grpc.time_ms=37.223 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1740gitlab # [ 234.400385] gitaly[893]: time="2026-10-04T17:43:23.664Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ diskcache=3e9fbee8-9eb2-423d-a220-88a3fd9d61ef grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:23.301" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1741gitlab # [ 234.401073] gitaly[893]: time="2026-10-04T17:43:23.664Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=196 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13949 command.oublock=32 command.real_time_ms=354 command.spawn_token_fork_ms=0 command.system_time_ms=122 command.user_time_ms=74 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:23.301" grpc.time_ms=362.838 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1742gitlab # [ 234.401820] gitlab-workhorse[826]: time="2026-10-04T17:43:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521743gitlab # [ 234.402410] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:23 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4251744gitlab # To http://gitlab/root/test-flake.git1745gitlab # f86e523..1bac1bd master -> master1746gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.65 seconds)1747gitlab: must succeed: git -C /tmp/test-flake rev-parse master1748gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1749gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65'1750gitlab # [ 234.458460] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.722Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1ab000e04be570ac54e25ded","created_at":"2026-10-04T17:42:34.594Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:34.629Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1ab000e04be570ac54e25ded: done: 0.146653 sec","job_status":"done","queue_duration_s":48.946194,"scheduling_latency_s":48.946234,"redis_calls":25,"redis_duration_s":0.003942,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.001948,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.088864367,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.146653,"completed_at":"2026-10-04T17:43:23.722Z","load_balancing_strategy":"primary","db_duration_s":0.058172,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1751gitlab # [ 234.488121] nixbot[2612]: INFO: ::ffff:127.0.0.1:45210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 200 OK1752gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65', in 0.06 seconds)1753gitlab # [ 234.500598] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.764Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5e8955553299e719c68a015c","created_at":"2026-10-04T17:42:34.637Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:34.645Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5e8955553299e719c68a015c: start","job_status":"start","queue_duration_s":49.119343,"scheduling_latency_s":49.119381}1754gitlab # [ 234.583220] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.846Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5e8955553299e719c68a015c","created_at":"2026-10-04T17:42:34.637Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:34.645Z","job_size_bytes":2,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5e8955553299e719c68a015c: done: 0.082629 sec","job_status":"done","queue_duration_s":49.119343,"scheduling_latency_s":49.119381,"redis_calls":14,"redis_duration_s":0.003097,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060334763000000007,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.082629,"completed_at":"2026-10-04T17:43:23.846Z","load_balancing_strategy":"primary","db_duration_s":0.015301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1755gitlab # [ 234.585651] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.848Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"adb632a795a2f7e3b45c54c0","created_at":"2026-10-04T17:42:35.100Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:35.104Z","job_size_bytes":5,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-adb632a795a2f7e3b45c54c0: start","job_status":"start","queue_duration_s":48.743197,"scheduling_latency_s":48.743211}1756gitlab # [ 234.693986] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.957Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"adb632a795a2f7e3b45c54c0","created_at":"2026-10-04T17:42:35.100Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:35.104Z","job_size_bytes":5,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-adb632a795a2f7e3b45c54c0: done: 0.109611 sec","job_status":"done","queue_duration_s":48.743197,"scheduling_latency_s":48.743211,"redis_calls":12,"redis_duration_s":0.0025800000000000003,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000603,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001546,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000297244,"duration_s":0.109611,"completed_at":"2026-10-04T17:43:23.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023683,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1757gitlab # [ 234.696059] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:23.959Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5db1c0c052bd667b6f0b3ca4","created_at":"2026-10-04T17:42:35.137Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:35.143Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5db1c0c052bd667b6f0b3ca4: start","job_status":"start","queue_duration_s":48.815493,"scheduling_latency_s":48.815507}1758gitlab # [ 234.857442] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.121Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5db1c0c052bd667b6f0b3ca4","created_at":"2026-10-04T17:42:35.137Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:35.143Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5db1c0c052bd667b6f0b3ca4: done: 0.162002 sec","job_status":"done","queue_duration_s":48.815493,"scheduling_latency_s":48.815507,"redis_calls":11,"redis_duration_s":0.002908,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000917,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.127,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.127,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279086,"duration_s":0.162002,"completed_at":"2026-10-04T17:43:24.121Z","load_balancing_strategy":"primary","db_duration_s":0.055312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1759gitlab # [ 234.860299] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.122Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8b923184bfbb8b2c9bb0e9e7","created_at":"2026-10-04T17:42:35.148Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:35.154Z","job_size_bytes":89,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8b923184bfbb8b2c9bb0e9e7: start","job_status":"start","queue_duration_s":48.968244,"scheduling_latency_s":48.968258}1760gitlab # [ 234.890563] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.146Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"8b923184bfbb8b2c9bb0e9e7","created_at":"2026-10-04T17:42:35.148Z","trace_propagation_headers":{"sentry-trace":"4f9bdd000f9c42a1a8a5b932e9b6a30c-95c88b435a994ec9","baggage":"sentry-trace_id=4f9bdd000f9c42a1a8a5b932e9b6a30c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44059M4VAZGDE22AQKGR9JV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:35.154Z","job_size_bytes":89,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-8b923184bfbb8b2c9bb0e9e7: done: 0.02422 sec","job_status":"done","queue_duration_s":48.968244,"scheduling_latency_s":48.968258,"redis_calls":11,"redis_duration_s":0.0023469999999999997,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000676,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283555,"duration_s":0.02422,"completed_at":"2026-10-04T17:43:24.146Z","load_balancing_strategy":"primary","db_duration_s":0.004768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761gitlab # [ 234.945660] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.147Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f86e5237bc7eb58df9207963e6720fdd3be7b2c9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a1fdfe30ce0de0088c7652fd","created_at":"2026-10-04T17:42:41.765Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-3487e8e6cac24e0a","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:41.784Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a1fdfe30ce0de0088c7652fd: start","job_status":"start","queue_duration_s":42.363095,"scheduling_latency_s":42.363107}1762gitlab # [ 234.961318] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.158Z","message":"changes: \"0000000000000000000000000000000000000000 f86e5237bc7eb58df9207963e6720fdd3be7b2c9 refs/heads/master\\n\""}1763gitlab # [ 234.964214] gitaly[893]: time="2026-10-04T17:43:24.188Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:34.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:24.178" grpc.time_ms=9.849 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 235.011162] gitaly[893]: time="2026-10-04T17:43:24.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:43:34.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:24.192" grpc.time_ms=9.151 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 235.031652] gitaly[893]: time="2026-10-04T17:43:24.295Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=47 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-04T17:43:34.072" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:24.242" grpc.time_ms=53.366 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 235.071931] gitaly[893]: time="2026-10-04T17:43:24.335Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:24.335" grpc.time_ms=0.309 pid=893 span.kind=server system=grpc1767gitlab # [ 235.109846] gitaly[893]: time="2026-10-04T17:43:24.373Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:24.373" grpc.time_ms=0.518 pid=893 span.kind=server system=grpc1768gitlab # [ 235.129348] gitaly[893]: time="2026-10-04T17:43:24.393Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 diskcache=85e00667-a6a7-4c72-b128-9feb92998990 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T17:43:34.146" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:24.317" pid=893 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1769gitlab # [ 235.138820] gitaly[893]: time="2026-10-04T17:43:24.393Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5152 command.oublock=8 command.real_time_ms=67 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T17:43:34.146" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:24.317" grpc.time_ms=76.394 pid=893 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1770gitlab # [ 235.152266] gitaly[893]: time="2026-10-04T17:43:24.416Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-04T17:43:34.245" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:24.416" grpc.time_ms=0.136 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 235.179586] gitaly[893]: time="2026-10-04T17:43:24.443Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=932 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-04T17:43:34.259" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:24.429" grpc.time_ms=13.709 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 235.263692] gitaly[893]: time="2026-10-04T17:43:24.527Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-04T17:43:54.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:24.522" grpc.time_ms=5.622 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 235.284879] gitaly[893]: time="2026-10-04T17:43:24.548Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T17:43:34.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:24.548" grpc.time_ms=0.31 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 235.294717] gitaly[893]: time="2026-10-04T17:43:24.558Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-04T17:43:34.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-04T17:43:24.552" grpc.time_ms=6.516 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 235.313781] gitaly[893]: time="2026-10-04T17:43:24.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:34.032" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:24.572" grpc.time_ms=4.823 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 235.327056] gitaly[893]: time="2026-10-04T17:43:24.591Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:34.040" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:24.580" grpc.time_ms=9.978 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 235.351109] gitaly[893]: time="2026-10-04T17:43:24.615Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-04T17:43:54.105" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:24.605" grpc.time_ms=9.11 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65'1779gitlab # [ 235.537632] nixbot[2612]: INFO: ::ffff:127.0.0.1:45212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 200 OK1780gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65', in 0.04 seconds)1781gitlab # [ 235.691500] gitaly[893]: time="2026-10-04T17:43:24.955Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-04T17:43:34.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:24.954" grpc.time_ms=1.007 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 235.732415] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.994Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f86e5237bc7eb58df9207963e6720fdd3be7b2c9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a1fdfe30ce0de0088c7652fd","created_at":"2026-10-04T17:42:41.765Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-3487e8e6cac24e0a","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:42:41.784Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a1fdfe30ce0de0088c7652fd: done: 0.8472 sec","job_status":"done","queue_duration_s":42.363095,"scheduling_latency_s":42.363107,"gitaly_calls":13,"gitaly_duration_s":0.250163,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.054597,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.004103,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006301,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001514,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003134,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.028195,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01135,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.166,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.186,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.481382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000683886,"exclusive_lock_hold_duration_s":0.024405336,"duration_s":0.8472,"completed_at":"2026-10-04T17:43:24.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1783gitlab # [ 235.738866] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:24.997Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"db09de5b2c0fb631221fc10f","created_at":"2026-10-04T17:42:46.525Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.532Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-db09de5b2c0fb631221fc10f: start","job_status":"start","queue_duration_s":38.464573,"scheduling_latency_s":38.464605}1784gitlab # [ 235.821874] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.085Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"db09de5b2c0fb631221fc10f","created_at":"2026-10-04T17:42:46.525Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.532Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-db09de5b2c0fb631221fc10f: done: 0.088146 sec","job_status":"done","queue_duration_s":38.464573,"scheduling_latency_s":38.464605,"redis_calls":16,"redis_duration_s":0.004411,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002101,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000466819,"duration_s":0.088146,"completed_at":"2026-10-04T17:43:25.085Z","load_balancing_strategy":"primary","db_duration_s":0.020496,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1785gitlab # [ 235.823735] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.086Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d572573182e133ec56a61848","created_at":"2026-10-04T17:42:46.533Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.538Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d572573182e133ec56a61848: start","job_status":"start","queue_duration_s":38.54852,"scheduling_latency_s":38.548534}1786gitlab # [ 235.900759] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.164Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d572573182e133ec56a61848","created_at":"2026-10-04T17:42:46.533Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.538Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d572573182e133ec56a61848: done: 0.07723 sec","job_status":"done","queue_duration_s":38.54852,"scheduling_latency_s":38.548534,"redis_calls":21,"redis_duration_s":0.004783,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001913,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000478273,"duration_s":0.07723,"completed_at":"2026-10-04T17:43:25.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1787gitlab # [ 235.902957] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.166Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"688a1f9c2e8bce7701042395","created_at":"2026-10-04T17:42:46.617Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.621Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-688a1f9c2e8bce7701042395: start","job_status":"start","queue_duration_s":38.544719,"scheduling_latency_s":38.544748}1788gitlab # [ 236.107412] gitaly[893]: time="2026-10-04T17:43:25.370Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:25.370" grpc.time_ms=0.301 pid=893 span.kind=server system=grpc1789gitlab # [ 236.152075] gitaly[893]: time="2026-10-04T17:43:25.416Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:25.415" grpc.time_ms=0.427 pid=893 span.kind=server system=grpc1790gitlab # [ 236.199109] gitaly[893]: time="2026-10-04T17:43:25.463Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:25.462" grpc.time_ms=0.208 pid=893 span.kind=server system=grpc1791gitlab # [ 236.226550] gitaly[893]: time="2026-10-04T17:43:25.490Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F diskcache=b15cca10-da07-4cb8-a87f-f80933ca01e2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:55.033" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:25.333" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 236.228065] gitaly[893]: time="2026-10-04T17:43:25.490Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=127 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7318 command.oublock=0 command.real_time_ms=147 command.spawn_token_fork_ms=0 command.system_time_ms=84 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:55.033" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:25.333" grpc.time_ms=156.793 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 236.380395] gitaly[893]: time="2026-10-04T17:43:25.644Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:55.142" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:25.642" grpc.time_ms=1.139 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 236.442827] gitaly[893]: time="2026-10-04T17:43:25.706Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405NGGJV2WRVE6RT5F415F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:55.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:25.705" grpc.time_ms=0.959 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 236.457665] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.721Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"688a1f9c2e8bce7701042395","created_at":"2026-10-04T17:42:46.617Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.621Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-688a1f9c2e8bce7701042395: rescheduled"}1796gitlab # [ 236.469788] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.733Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"688a1f9c2e8bce7701042395","created_at":"2026-10-04T17:42:46.617Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-344628ad1ae54c3a","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:42:46.621Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-688a1f9c2e8bce7701042395: done: 0.567131 sec","job_status":"done","queue_duration_s":38.544719,"scheduling_latency_s":38.544748,"gitaly_calls":3,"gitaly_duration_s":0.194372,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.029051,"redis_read_bytes":460,"redis_write_bytes":29297,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000972,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001433,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010248,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004879,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15584,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006672,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000551,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000736,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002588,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.02,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.268057,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.500531492,"duration_s":0.567131,"completed_at":"2026-10-04T17:43:25.733Z","load_balancing_strategy":"primary","db_duration_s":0.084872,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65'1798gitlab # [ 236.500830] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.735Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f86e5237bc7eb58df9207963e6720fdd3be7b2c9 1bac1bdf058413228a5e5ffe12ebe66f522aca65 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9a6ab864889fb9119f2a7f91","created_at":"2026-10-04T17:43:23.631Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-a54469143f9046d1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:43:23.632Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9a6ab864889fb9119f2a7f91: start","job_status":"start","queue_duration_s":2.103202,"scheduling_latency_s":2.103232}1799gitlab # [ 236.541645] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.750Z","message":"changes: \"f86e5237bc7eb58df9207963e6720fdd3be7b2c9 1bac1bdf058413228a5e5ffe12ebe66f522aca65 refs/heads/master\\n\""}1800gitlab # [ 236.542405] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.796Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"040bd8b026e43f50ff663650","created_at":"2026-10-04T17:43:25.794Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"2e5609845c0aabc53e4ea528","job_size_bytes":46,"pid":2488,"job_status":"deduplicated","message":"ProjectCacheWorker JID-040bd8b026e43f50ff663650: deduplicated: until executing","deduplication.type":"until executing"}1801gitlab # [ 236.543071] gitaly[893]: time="2026-10-04T17:43:25.780Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:35.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:25.770" grpc.time_ms=9.533 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 236.543722] gitaly[893]: time="2026-10-04T17:43:25.793Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-04T17:43:35.244" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:25.784" grpc.time_ms=8.649 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 236.588536] gitaly[893]: time="2026-10-04T17:43:25.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-04T17:43:35.268" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:25.808" grpc.time_ms=7.786 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 236.589421] gitaly[893]: time="2026-10-04T17:43:25.829Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-04T17:43:55.322" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:25.822" grpc.time_ms=7.257 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 236.593867] gitaly[893]: time="2026-10-04T17:43:25.857Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-04T17:43:35.014" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-04T17:43:25.854" grpc.time_ms=3.394 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 236.603801] gitaly[893]: time="2026-10-04T17:43:25.867Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:35.023" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:25.863" grpc.time_ms=4.384 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 236.613139] nixbot[2612]: INFO: ::ffff:127.0.0.1:45228 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 200 OK1808gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65', in 0.10 seconds)1809gitlab # [ 236.658332] gitaly[893]: time="2026-10-04T17:43:25.922Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-04T17:43:35.081" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:25.921" grpc.time_ms=0.732 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 236.692261] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:25.955Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f86e5237bc7eb58df9207963e6720fdd3be7b2c9 1bac1bdf058413228a5e5ffe12ebe66f522aca65 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9a6ab864889fb9119f2a7f91","created_at":"2026-10-04T17:43:23.631Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-a54469143f9046d1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-04T17:43:23.632Z","job_size_bytes":185,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9a6ab864889fb9119f2a7f91: done: 0.220202 sec","job_status":"done","queue_duration_s":2.103202,"scheduling_latency_s":2.103232,"gitaly_calls":7,"gitaly_duration_s":0.085956,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.016256,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001551,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.00057,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002465,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006569,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005101,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000689194,"exclusive_lock_hold_duration_s":0.019647469,"duration_s":0.220202,"completed_at":"2026-10-04T17:43:25.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020651,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1811gitlab # [ 236.737322] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.000Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2e5609845c0aabc53e4ea528","created_at":"2026-10-04T17:43:24.206Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.220Z","job_size_bytes":46,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2e5609845c0aabc53e4ea528: start","job_status":"start","queue_duration_s":1.780183,"scheduling_latency_s":1.780222}1812gitlab # [ 236.808970] gitaly[893]: time="2026-10-04T17:43:26.072Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-04T23:43:26.067" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:26.067" grpc.time_ms=4.746 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 236.846372] gitaly[893]: time="2026-10-04T17:43:26.110Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-04T17:43:56.098" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.099" grpc.time_ms=10.996 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 236.881916] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.145Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2e5609845c0aabc53e4ea528","created_at":"2026-10-04T17:43:24.206Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.220Z","job_size_bytes":46,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2e5609845c0aabc53e4ea528: done: 0.144795 sec","job_status":"done","queue_duration_s":1.780183,"scheduling_latency_s":1.780222,"gitaly_calls":2,"gitaly_duration_s":0.039401,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008076,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001633,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000828,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002803,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048414,"duration_s":0.144795,"completed_at":"2026-10-04T17:43:26.145Z","load_balancing_strategy":"primary","db_duration_s":0.013596,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1815gitlab # [ 236.934145] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.197Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"32bdca36fe55790cc0cd215c","created_at":"2026-10-04T17:43:24.233Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.238Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-32bdca36fe55790cc0cd215c: start","job_status":"start","queue_duration_s":1.959282,"scheduling_latency_s":1.959321}1816gitlab # [ 236.994232] gitaly[893]: time="2026-10-04T17:43:26.258Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 diskcache=b36a8eca-7deb-47ba-a288-3a71022c77e8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T23:43:26.228" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.228" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 236.995399] gitaly[893]: time="2026-10-04T17:43:26.258Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1278 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T23:43:26.228" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.228" grpc.time_ms=29.441 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 237.042581] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.305Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"32bdca36fe55790cc0cd215c","created_at":"2026-10-04T17:43:24.233Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.238Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-32bdca36fe55790cc0cd215c: done: 0.108465 sec","job_status":"done","queue_duration_s":1.959282,"scheduling_latency_s":1.959321,"gitaly_calls":1,"gitaly_duration_s":0.032497,"redis_calls":15,"redis_duration_s":0.004572,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000792,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.024,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07564760300000001,"duration_s":0.108465,"completed_at":"2026-10-04T17:43:26.305Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018305,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1819gitlab # [ 237.044826] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.308Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0127fcc5dc4e4d6d30d81967","created_at":"2026-10-04T17:43:24.410Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.413Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0127fcc5dc4e4d6d30d81967: start","job_status":"start","queue_duration_s":1.895162,"scheduling_latency_s":1.895256}1820gitlab # [ 237.084471] gitaly[893]: time="2026-10-04T17:43:26.348Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-04T17:43:56.337" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.337" grpc.time_ms=10.633 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 237.115436] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.379Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0127fcc5dc4e4d6d30d81967","created_at":"2026-10-04T17:43:24.410Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.413Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0127fcc5dc4e4d6d30d81967: done: 0.071143 sec","job_status":"done","queue_duration_s":1.895162,"scheduling_latency_s":1.895256,"gitaly_calls":1,"gitaly_duration_s":0.03712,"redis_calls":16,"redis_duration_s":0.004071,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.00027,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001909,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071143,"completed_at":"2026-10-04T17:43:26.379Z","load_balancing_strategy":"primary","db_duration_s":0.003299,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1822gitlab # [ 237.117162] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:26.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fa747f6016bea303a270ae36","created_at":"2026-10-04T17:43:24.825Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1af38f71c5dd851bb88888d1426b8fbce04ccf3b097700ca7af6b00793f2ed65","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.832Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fa747f6016bea303a270ae36: start","job_status":"start","queue_duration_s":1.548138,"scheduling_latency_s":1.548154}1823gitlab # [ 237.134958] gitaly[893]: time="2026-10-04T17:43:26.398Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:56.397" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.397" grpc.time_ms=0.623 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 237.190280] gitaly[893]: time="2026-10-04T17:43:26.454Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T17:43:36.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:26.446" grpc.time_ms=7.27 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 237.320264] gitaly[893]: time="2026-10-04T17:43:26.584Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:56.582" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.583" grpc.time_ms=1.055 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 237.325378] gitaly[893]: time="2026-10-04T17:43:26.589Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-04T17:43:56.586" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:26.586" grpc.time_ms=2.668 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 237.443789] gitaly[893]: time="2026-10-04T17:43:26.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:36.256" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:26.696" grpc.time_ms=10.927 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65'1829gitlab # [ 237.685391] nixbot[2612]: INFO: ::ffff:127.0.0.1:45240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 200 OK1830gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65', in 0.04 seconds)1831gitlab # [ 237.870499] gitaly[893]: time="2026-10-04T17:43:27.134Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-04T17:43:57.116" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.117" grpc.time_ms=16.977 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 237.887599] gitaly[893]: time="2026-10-04T17:43:27.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4405GJSC506HNJK8GJ2CRH7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-04T17:43:57.138" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.138" grpc.time_ms=12.828 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 237.919499] sidekiq-cluster[2488]: {"severity":"WARN","time":"2026-10-04T17:43:27.182Z","class":"CreatePipelineWorker","correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"f86e5237bc7eb58df9207963e6720fdd3be7b2c9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f86e5237bc7eb58df9207963e6720fdd3be7b2c9","ref":"refs/heads/master"},"retry":0}1834gitlab # [ 237.927518] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.191Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fa747f6016bea303a270ae36","created_at":"2026-10-04T17:43:24.825Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1af38f71c5dd851bb88888d1426b8fbce04ccf3b097700ca7af6b00793f2ed65","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.832Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fa747f6016bea303a270ae36: done: 0.810538 sec","job_status":"done","queue_duration_s":1.548138,"scheduling_latency_s":1.548154,"gitaly_calls":7,"gitaly_duration_s":0.16585,"redis_calls":51,"redis_duration_s":0.00966,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000872,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004262,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002488,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.582537,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400889,"duration_s":0.810538,"completed_at":"2026-10-04T17:43:27.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048013,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1835gitlab # [ 237.977854] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.192Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7c844dcc-fe64-4745-9051-663972a1d9bf\"}"],"class":"WebHookWorker","jid":"932c79d5b83510c4d5808b28","created_at":"2026-10-04T17:43:24.931Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8f568798c54b960e208585f481a7906e33990a502767c35cc39459ea8252eef3","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.936Z","job_size_bytes":1751,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-932c79d5b83510c4d5808b28: start","job_status":"start","queue_duration_s":2.256388,"scheduling_latency_s":2.256414}1836gitlab # [ 238.017086] nixbot[2612]: INFO: ::ffff:127.0.0.1:45246 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1837gitlab # [ 238.030601] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.294Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7c844dcc-fe64-4745-9051-663972a1d9bf\"}"],"class":"WebHookWorker","jid":"932c79d5b83510c4d5808b28","created_at":"2026-10-04T17:43:24.931Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-5224f90391f44fef","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8f568798c54b960e208585f481a7906e33990a502767c35cc39459ea8252eef3","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:24.936Z","job_size_bytes":1751,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-932c79d5b83510c4d5808b28: done: 0.101627 sec","job_status":"done","queue_duration_s":2.256388,"scheduling_latency_s":2.256414,"redis_calls":19,"redis_duration_s":0.003381,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000817,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000848,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03301872100001901,"cpu_s":0.056991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237181,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.101627,"completed_at":"2026-10-04T17:43:27.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 238.075512] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"035d6f0b54034c7e0c212010","created_at":"2026-10-04T17:43:25.323Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.326Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-035d6f0b54034c7e0c212010: start","job_status":"start","queue_duration_s":2.012925,"scheduling_latency_s":2.012959}1839gitlab # [ 238.115307] gitaly[893]: time="2026-10-04T17:43:27.379Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406XT35XAVA3NJCBVNN2G7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:27.372" grpc.time_ms=6.85 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1840gitlab # [ 238.116324] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 801841gitlab # [ 238.156734] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.420Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"035d6f0b54034c7e0c212010","created_at":"2026-10-04T17:43:25.323Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.326Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-035d6f0b54034c7e0c212010: done: 0.081498 sec","job_status":"done","queue_duration_s":2.012925,"scheduling_latency_s":2.012959,"redis_calls":10,"redis_duration_s":0.002308,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000571,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000493,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000273219,"duration_s":0.081498,"completed_at":"2026-10-04T17:43:27.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027125,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1842gitlab # [ 238.157847] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.421Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7389449f187414c4fb6a6c64","created_at":"2026-10-04T17:43:25.522Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.527Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7389449f187414c4fb6a6c64: start","job_status":"start","queue_duration_s":1.894698,"scheduling_latency_s":1.894713}1843gitlab # [ 238.203280] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.442Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7389449f187414c4fb6a6c64","created_at":"2026-10-04T17:43:25.522Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.527Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7389449f187414c4fb6a6c64: done: 0.020781 sec","job_status":"done","queue_duration_s":1.894698,"scheduling_latency_s":1.894713,"redis_calls":10,"redis_duration_s":0.001919,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254781,"duration_s":0.020781,"completed_at":"2026-10-04T17:43:27.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1844gitlab # [ 238.243317] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9bfe2b943fe37f5d157a0cd6","created_at":"2026-10-04T17:43:25.540Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.546Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9bfe2b943fe37f5d157a0cd6: start","job_status":"start","queue_duration_s":1.897273,"scheduling_latency_s":1.897297}1845gitlab # [ 238.244347] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9bfe2b943fe37f5d157a0cd6","created_at":"2026-10-04T17:43:25.540Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.546Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9bfe2b943fe37f5d157a0cd6: done: 0.020821 sec","job_status":"done","queue_duration_s":1.897273,"scheduling_latency_s":1.897297,"redis_calls":10,"redis_duration_s":0.0020239999999999998,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000260648,"duration_s":0.020821,"completed_at":"2026-10-04T17:43:27.464Z","load_balancing_strategy":"primary","db_duration_s":0.003256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1846gitlab # [ 238.264108] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.465Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4cbaf54eebbb966511785716","created_at":"2026-10-04T17:43:25.561Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.565Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4cbaf54eebbb966511785716: start","job_status":"start","queue_duration_s":1.899767,"scheduling_latency_s":1.89978}1847gitlab # [ 238.309343] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.501Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4cbaf54eebbb966511785716","created_at":"2026-10-04T17:43:25.561Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.565Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4cbaf54eebbb966511785716: done: 0.036044 sec","job_status":"done","queue_duration_s":1.899767,"scheduling_latency_s":1.89978,"redis_calls":13,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000652,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000281879,"duration_s":0.036044,"completed_at":"2026-10-04T17:43:27.501Z","load_balancing_strategy":"primary","db_duration_s":0.004723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848gitlab # [ 238.317561] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.502Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0fa97895b7e0667f047ce393","created_at":"2026-10-04T17:43:25.566Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.570Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0fa97895b7e0667f047ce393: start","job_status":"start","queue_duration_s":1.932112,"scheduling_latency_s":1.932125}1849gitlab # [ 238.355990] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0fa97895b7e0667f047ce393","created_at":"2026-10-04T17:43:25.566Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.570Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0fa97895b7e0667f047ce393: done: 0.039832 sec","job_status":"done","queue_duration_s":1.932112,"scheduling_latency_s":1.932125,"redis_calls":10,"redis_duration_s":0.002457,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000427429,"duration_s":0.039832,"completed_at":"2026-10-04T17:43:27.542Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850gitlab # [ 238.371725] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.544Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0997ee0e5f6148872d55c496","created_at":"2026-10-04T17:43:25.571Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.574Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0997ee0e5f6148872d55c496: start","job_status":"start","queue_duration_s":1.969615,"scheduling_latency_s":1.969639}1851gitlab # [ 238.386672] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0997ee0e5f6148872d55c496","created_at":"2026-10-04T17:43:25.571Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.574Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0997ee0e5f6148872d55c496: done: 0.035129 sec","job_status":"done","queue_duration_s":1.969615,"scheduling_latency_s":1.969639,"redis_calls":11,"redis_duration_s":0.002138,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036485,"duration_s":0.035129,"completed_at":"2026-10-04T17:43:27.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab # [ 238.438081] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.581Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b4264767058c8c75b7cad51d","created_at":"2026-10-04T17:43:25.578Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.583Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b4264767058c8c75b7cad51d: start","job_status":"start","queue_duration_s":1.997337,"scheduling_latency_s":1.997361}1853gitlab # [ 238.440921] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.692Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b4264767058c8c75b7cad51d","created_at":"2026-10-04T17:43:25.578Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.583Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b4264767058c8c75b7cad51d: done: 0.111794 sec","job_status":"done","queue_duration_s":1.997337,"scheduling_latency_s":1.997361,"redis_calls":10,"redis_duration_s":0.001913,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.075,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000387479,"duration_s":0.111794,"completed_at":"2026-10-04T17:43:27.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1854gitlab # [ 238.480174] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.694Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c669ed0c1b12382a8b556c6f","created_at":"2026-10-04T17:43:25.584Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.589Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c669ed0c1b12382a8b556c6f: start","job_status":"start","queue_duration_s":2.104945,"scheduling_latency_s":2.104974}1855gitlab # [ 238.495342] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c669ed0c1b12382a8b556c6f","created_at":"2026-10-04T17:43:25.584Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.589Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c669ed0c1b12382a8b556c6f: done: 0.039792 sec","job_status":"done","queue_duration_s":2.104945,"scheduling_latency_s":2.104974,"redis_calls":10,"redis_duration_s":0.001457,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000319,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.039792,"completed_at":"2026-10-04T17:43:27.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 238.545140] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.735Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bc21e288cab8bac0a6b4213a","created_at":"2026-10-04T17:43:25.597Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.602Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bc21e288cab8bac0a6b4213a: start","job_status":"start","queue_duration_s":2.132517,"scheduling_latency_s":2.13253}1857gitlab # [ 238.549198] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.756Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bc21e288cab8bac0a6b4213a","created_at":"2026-10-04T17:43:25.597Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.602Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bc21e288cab8bac0a6b4213a: done: 0.020799 sec","job_status":"done","queue_duration_s":2.132517,"scheduling_latency_s":2.13253,"redis_calls":10,"redis_duration_s":0.001412,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200585,"duration_s":0.020799,"completed_at":"2026-10-04T17:43:27.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 238.600293] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.756Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6fa89a1c3f61a2d9bb1923aa","created_at":"2026-10-04T17:43:25.603Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.610Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6fa89a1c3f61a2d9bb1923aa: start","job_status":"start","queue_duration_s":2.146074,"scheduling_latency_s":2.146086}1859gitlab # [ 238.602712] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.769Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6fa89a1c3f61a2d9bb1923aa","created_at":"2026-10-04T17:43:25.603Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.610Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6fa89a1c3f61a2d9bb1923aa: done: 0.012356 sec","job_status":"done","queue_duration_s":2.146074,"scheduling_latency_s":2.146086,"redis_calls":10,"redis_duration_s":0.00121,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189131,"duration_s":0.012356,"completed_at":"2026-10-04T17:43:27.769Z","load_balancing_strategy":"primary","db_duration_s":0.001162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65'1861gitlab # [ 238.646135] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.770Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a1ba8d93746cfe4b46253986","created_at":"2026-10-04T17:43:25.611Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.617Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a1ba8d93746cfe4b46253986: start","job_status":"start","queue_duration_s":2.152588,"scheduling_latency_s":2.152601}1862gitlab # [ 238.689263] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.788Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a1ba8d93746cfe4b46253986","created_at":"2026-10-04T17:43:25.611Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.617Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a1ba8d93746cfe4b46253986: done: 0.018685 sec","job_status":"done","queue_duration_s":2.152588,"scheduling_latency_s":2.152601,"redis_calls":10,"redis_duration_s":0.001227,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191644,"duration_s":0.018685,"completed_at":"2026-10-04T17:43:27.788Z","load_balancing_strategy":"primary","db_duration_s":0.003485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 238.692687] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.789Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"25cd5d016494884c78c07167","created_at":"2026-10-04T17:43:25.624Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.630Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-25cd5d016494884c78c07167: start","job_status":"start","queue_duration_s":2.159604,"scheduling_latency_s":2.159616}1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65', in 0.06 seconds)1865gitlab # [ 238.707709] gitaly[893]: time="2026-10-04T17:43:27.918Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ diskcache=48348a5e-0295-4207-b3bd-a5ce9f46b0c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T23:43:27.847" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.905" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 238.716202] gitaly[893]: time="2026-10-04T17:43:27.918Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-04T23:43:27.847" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.905" grpc.time_ms=13.133 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 238.757769] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.822Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"25cd5d016494884c78c07167","created_at":"2026-10-04T17:43:25.624Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.630Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-25cd5d016494884c78c07167: done: 0.032804 sec","job_status":"done","queue_duration_s":2.159604,"scheduling_latency_s":2.159616,"redis_calls":14,"redis_duration_s":0.002304,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"duration_s":0.032804,"completed_at":"2026-10-04T17:43:27.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1868gitlab # [ 238.767065] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.823Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"92468fd4ace7e67f1092c1cc","created_at":"2026-10-04T17:43:25.721Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.724Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-92468fd4ace7e67f1092c1cc: start","job_status":"start","queue_duration_s":2.099491,"scheduling_latency_s":2.099504}1869gitlab # [ 238.781491] nixbot[2612]: INFO: ::ffff:127.0.0.1:45258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 200 OK1870gitlab # [ 238.782945] gitaly[893]: time="2026-10-04T17:43:27.942Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:57.641" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.942" grpc.time_ms=0.713 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 238.793924] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.837Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"92468fd4ace7e67f1092c1cc","created_at":"2026-10-04T17:43:25.721Z","trace_propagation_headers":{"sentry-trace":"5c7a09bc1d1f49279a8b1501bb00e0e9-f7fe474c2e384797","baggage":"sentry-trace_id=5c7a09bc1d1f49279a8b1501bb00e0e9,sentry-release=Unknown"},"correlation_id":"01M4405NGGJV2WRVE6RT5F415F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.724Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-92468fd4ace7e67f1092c1cc: done: 0.013936 sec","job_status":"done","queue_duration_s":2.099491,"scheduling_latency_s":2.099504,"redis_calls":8,"redis_duration_s":0.00097,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013936,"completed_at":"2026-10-04T17:43:27.837Z","load_balancing_strategy":"primary","db_duration_s":0.001969,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1872gitlab # [ 238.841576] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.838Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e157ede123bb5f9faa1a30cd","created_at":"2026-10-04T17:43:25.802Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"32bdca36fe55790cc0cd215c","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.804Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e157ede123bb5f9faa1a30cd: start","job_status":"start","queue_duration_s":2.033861,"scheduling_latency_s":2.033873}1873gitlab # [ 238.844955] gitaly[893]: time="2026-10-04T17:43:27.949Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T17:43:37.103" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:27.944" grpc.time_ms=5.511 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 238.856559] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.928Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e157ede123bb5f9faa1a30cd","created_at":"2026-10-04T17:43:25.802Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"32bdca36fe55790cc0cd215c","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.804Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e157ede123bb5f9faa1a30cd: done: 0.08985 sec","job_status":"done","queue_duration_s":2.033861,"scheduling_latency_s":2.033873,"gitaly_calls":1,"gitaly_duration_s":0.072273,"redis_calls":12,"redis_duration_s":0.001541,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000333,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.079942003,"duration_s":0.08985,"completed_at":"2026-10-04T17:43:27.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1875gitlab # [ 238.897601] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:27.929Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"51e8f7bc2a50fc4ea3835ee0","created_at":"2026-10-04T17:43:25.900Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b297aa86419421078a6585b6b2086fa30a18e1bb827015b16900e9f2f9ac5f1","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.902Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-51e8f7bc2a50fc4ea3835ee0: start","job_status":"start","queue_duration_s":2.026704,"scheduling_latency_s":2.026716}1876gitlab # [ 238.911182] gitaly[893]: time="2026-10-04T17:43:27.967Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:57.666" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.967" grpc.time_ms=0.411 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 238.949885] gitaly[893]: time="2026-10-04T17:43:27.972Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=267 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-04T17:43:57.669" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:27.969" grpc.time_ms=2.478 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 238.950572] gitaly[893]: time="2026-10-04T17:43:28.007Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:38.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.001" grpc.time_ms=6.23 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 239.001292] gitaly[893]: time="2026-10-04T17:43:28.265Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4406XWNSVKGV2MTWYZ5DAPR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.259" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1880gitlab # [ 239.002139] gitaly[893]: time="2026-10-04T17:43:28.265Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4406XWNSVKGV2MTWYZ5DAPR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.259" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1881gitlab # [ 239.002851] gitaly[893]: time="2026-10-04T17:43:28.265Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4406XWNSVKGV2MTWYZ5DAPR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.259" grpc.time_ms=6.056 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1882gitlab # [ 239.034674] gitlab-workhorse[826]: time="2026-10-04T17:43:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671883gitlab # [ 239.035418] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 9171884gitlab # [ 239.080742] gitaly[893]: time="2026-10-04T17:43:28.344Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YSDYQWJDD698R7ZCAAW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.334" pid=893 remote_ip="2001:db8:1::1" request_sha=3d97de181ef86d0a257b572e5941ce4c2b12ec2c response_bytes=337 span.kind=server system=grpc1885gitlab # [ 239.081501] gitaly[893]: time="2026-10-04T17:43:28.344Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YSDYQWJDD698R7ZCAAW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.334" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1886gitlab # [ 239.083028] gitaly[893]: time="2026-10-04T17:43:28.345Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YSDYQWJDD698R7ZCAAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.334" grpc.time_ms=10.707 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 239.084809] gitlab-workhorse[826]: time="2026-10-04T17:43:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371888gitlab # [ 239.087080] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 441889gitlab # [ 239.125695] gitaly[893]: time="2026-10-04T17:43:28.389Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=29 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=29 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=959 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-04T17:43:58.348" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.348" grpc.time_ms=41.131 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 239.137163] gitaly[893]: time="2026-10-04T17:43:28.401Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406SV7VY675V7SEBY9NYHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-04T17:43:58.391" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.392" grpc.time_ms=8.706 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 239.146094] sidekiq-cluster[2488]: {"severity":"WARN","time":"2026-10-04T17:43:28.409Z","class":"CreatePipelineWorker","correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"f86e5237bc7eb58df9207963e6720fdd3be7b2c9","after":"1bac1bdf058413228a5e5ffe12ebe66f522aca65","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1bac1bdf058413228a5e5ffe12ebe66f522aca65","ref":"refs/heads/master"},"retry":0}1892gitlab # [ 239.148945] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"51e8f7bc2a50fc4ea3835ee0","created_at":"2026-10-04T17:43:25.900Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b297aa86419421078a6585b6b2086fa30a18e1bb827015b16900e9f2f9ac5f1","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.902Z","job_size_bytes":467,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-51e8f7bc2a50fc4ea3835ee0: done: 0.483627 sec","job_status":"done","queue_duration_s":2.026704,"scheduling_latency_s":2.026716,"gitaly_calls":7,"gitaly_duration_s":0.07555,"redis_calls":33,"redis_duration_s":0.003342,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000367,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001738,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.375338,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.483627,"completed_at":"2026-10-04T17:43:28.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027296,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1893gitlab # [ 239.160646] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.413Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"12aa335f-a845-488b-be67-689c3765db9d\"}"],"class":"WebHookWorker","jid":"a377bc9b9f412b38868d6b64","created_at":"2026-10-04T17:43:25.911Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:087643e38e9d562d23235821ecdd7e93327131a21bca3d53855172763cc9d28a","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.913Z","job_size_bytes":1749,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a377bc9b9f412b38868d6b64: start","job_status":"start","queue_duration_s":2.500356,"scheduling_latency_s":2.500373}1894gitlab # [ 239.221924] nixbot[2612]: INFO: ::ffff:127.0.0.1:45260 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1895gitlab # [ 239.228183] nixbot[2612]: {"ts": "2026-10-04T17:43:28.492Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1896gitlab # [ 239.237475] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.500Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"12aa335f-a845-488b-be67-689c3765db9d\"}"],"class":"WebHookWorker","jid":"a377bc9b9f412b38868d6b64","created_at":"2026-10-04T17:43:25.911Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-982f3954240c44b1","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:087643e38e9d562d23235821ecdd7e93327131a21bca3d53855172763cc9d28a","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:25.913Z","job_size_bytes":1749,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a377bc9b9f412b38868d6b64: done: 0.086805 sec","job_status":"done","queue_duration_s":2.500356,"scheduling_latency_s":2.500373,"redis_calls":14,"redis_duration_s":0.00224,"redis_read_bytes":25,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.00038,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0610898870000085,"cpu_s":0.01905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.086805,"completed_at":"2026-10-04T17:43:28.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1897gitlab # [ 239.239813] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e115d044a308cfba10125b82","created_at":"2026-10-04T17:43:26.121Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-19965622f5d645c4","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:26.127Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e115d044a308cfba10125b82: start","job_status":"start","queue_duration_s":2.375417,"scheduling_latency_s":2.375453}1898gitlab # [ 239.282161] gitaly[893]: time="2026-10-04T17:43:28.537Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:58.136" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.536" grpc.time_ms=0.401 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899gitlab # [ 239.289106] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.552Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e115d044a308cfba10125b82","created_at":"2026-10-04T17:43:26.121Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-19965622f5d645c4","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:26.127Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e115d044a308cfba10125b82: done: 0.049643 sec","job_status":"done","queue_duration_s":2.375417,"scheduling_latency_s":2.375453,"redis_calls":19,"redis_duration_s":0.007817000000000001,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001153,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.002197,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003233,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007270198,"duration_s":0.049643,"completed_at":"2026-10-04T17:43:28.552Z","load_balancing_strategy":"primary","db_duration_s":0.005626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1900gitlab # [ 239.305749] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.556Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","932c79d5b83510c4d5808b28"],"class":"WebHooks::LogExecutionWorker","jid":"c5b80b4a456aa01ef38ff052","created_at":"2026-10-04T17:43:27.282Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-c70ff1b6f7e94f54","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:824a0cafc9acc9ad26e3096bc2d4e978f05345a2c15e832303871f15719813cc","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:27.288Z","job_size_bytes":2593,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c5b80b4a456aa01ef38ff052: start","job_status":"start","queue_duration_s":1.268326,"scheduling_latency_s":1.268347}1901gitlab # [ 239.351801] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.588Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","932c79d5b83510c4d5808b28"],"class":"WebHooks::LogExecutionWorker","jid":"c5b80b4a456aa01ef38ff052","created_at":"2026-10-04T17:43:27.282Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-c70ff1b6f7e94f54","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:824a0cafc9acc9ad26e3096bc2d4e978f05345a2c15e832303871f15719813cc","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:27.288Z","job_size_bytes":2593,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c5b80b4a456aa01ef38ff052: done: 0.031647 sec","job_status":"done","queue_duration_s":1.268326,"scheduling_latency_s":1.268347,"redis_calls":10,"redis_duration_s":0.0016890000000000002,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198628,"duration_s":0.031647,"completed_at":"2026-10-04T17:43:28.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1902gitlab # [ 239.362199] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.590Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a377bc9b9f412b38868d6b64"],"class":"WebHooks::LogExecutionWorker","jid":"c5886319290303ccde51ae01","created_at":"2026-10-04T17:43:28.489Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-0392ab5bbc2443a0","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c4d69f537c6f8f71a9fb0203d478271cba3b8c1333d23c6c19a97f6b2be7aa5d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.493Z","job_size_bytes":2591,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c5886319290303ccde51ae01: start","job_status":"start","queue_duration_s":0.097027,"scheduling_latency_s":0.097041}1903gitlab # [ 239.376509] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 811904gitlab # [ 239.377349] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1201905gitlab # [ 239.384167] gitlab-workhorse[826]: time="2026-10-04T17:43:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671906gitlab # [ 239.384859] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 441907gitlab # [ 239.385509] gitaly[893]: time="2026-10-04T17:43:28.585Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:38.189" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.579" grpc.time_ms=5.421 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 239.432022] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.609Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a377bc9b9f412b38868d6b64"],"class":"WebHooks::LogExecutionWorker","jid":"c5886319290303ccde51ae01","created_at":"2026-10-04T17:43:28.489Z","trace_propagation_headers":{"sentry-trace":"616df8308d544059b0a35af770ec3a51-0392ab5bbc2443a0","baggage":"sentry-trace_id=616df8308d544059b0a35af770ec3a51,sentry-release=Unknown"},"correlation_id":"01M4406SV7VY675V7SEBY9NYHZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c4d69f537c6f8f71a9fb0203d478271cba3b8c1333d23c6c19a97f6b2be7aa5d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.493Z","job_size_bytes":2591,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c5886319290303ccde51ae01: done: 0.019644 sec","job_status":"done","queue_duration_s":0.097027,"scheduling_latency_s":0.097041,"redis_calls":7,"redis_duration_s":0.002081,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019644,"completed_at":"2026-10-04T17:43:28.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1909gitlab # [ 239.432985] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"565a3bae06fcdf6bfd67c861","created_at":"2026-10-04T17:43:28.540Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-196541c7e22e481c","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.544Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-565a3bae06fcdf6bfd67c861: start","job_status":"start","queue_duration_s":0.066682,"scheduling_latency_s":0.066696}1910gitlab # [ 239.475719] nixbot[2612]: {"ts": "2026-10-04T17:43:28.622Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}1911gitlab # [ 239.476550] gitaly[893]: time="2026-10-04T17:43:28.589Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=46 command.spawn_token_fork_ms=42 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406YZXZTR4M4B51TJ8B572 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.541" grpc.time_ms=47.671 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 239.477242] gitaly[893]: time="2026-10-04T17:43:28.638Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z2J9PYH9DA1ZFJMCT48 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.631" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1913gitlab # [ 239.477933] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"565a3bae06fcdf6bfd67c861","created_at":"2026-10-04T17:43:28.540Z","trace_propagation_headers":{"sentry-trace":"9d24fa824d3f442b8d091f70f79d6b44-196541c7e22e481c","baggage":"sentry-trace_id=9d24fa824d3f442b8d091f70f79d6b44,sentry-release=Unknown"},"correlation_id":"01M4405GJSC506HNJK8GJ2CRH7","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.544Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-565a3bae06fcdf6bfd67c861: done: 0.068044 sec","job_status":"done","queue_duration_s":0.066682,"scheduling_latency_s":0.066696,"redis_calls":11,"redis_duration_s":0.008808,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002828,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003696,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000562083,"duration_s":0.068044,"completed_at":"2026-10-04T17:43:28.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01641,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1914gitlab # [ 239.513108] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.681Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"68d417bec7218c77b286302f","created_at":"2026-10-04T17:43:28.608Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-becd8b0356644f46","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.611Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68d417bec7218c77b286302f: start","job_status":"start","queue_duration_s":0.070011,"scheduling_latency_s":0.070025}1915gitlab # [ 239.559187] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 441916gitlab # [ 239.559849] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1401917gitlab # [ 239.560568] gitlab-workhorse[826]: time="2026-10-04T17:43:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211918gitlab # [ 239.561122] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 761919gitlab # [ 239.561615] gitaly[893]: time="2026-10-04T17:43:28.638Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z2J9PYH9DA1ZFJMCT48 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.631" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab # [ 239.562377] nixbot[2612]: {"ts": "2026-10-04T17:43:28.767Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}1921gitlab # [ 239.562869] gitaly[893]: time="2026-10-04T17:43:28.638Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z2J9PYH9DA1ZFJMCT48 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.631" grpc.time_ms=6.67 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1922gitlab # [ 239.563491] gitaly[893]: time="2026-10-04T17:43:28.690Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z3H14AXT79QX5C7XH4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:58.288" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.688" grpc.time_ms=1.081 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 239.604168] gitaly[893]: time="2026-10-04T17:43:28.714Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406Z3H14AXT79QX5C7XH4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:38.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.708" grpc.time_ms=5.367 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 239.604815] gitaly[893]: time="2026-10-04T17:43:28.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4406Z5CW2SHQSVP16ZC3SWV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.723" grpc.time_ms=4.968 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 239.605369] gitaly[893]: time="2026-10-04T17:43:28.754Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:28.754" grpc.time_ms=0.252 pid=893 span.kind=server system=grpc1926gitlab # [ 239.607962] gitaly[893]: time="2026-10-04T17:43:28.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:28.787" grpc.time_ms=0.656 pid=893 span.kind=server system=grpc1927gitlab # [ 239.613066] gitaly[893]: time="2026-10-04T17:43:28.805Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z6T64M3WQDCQ8AD43V1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.773" pid=893 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1928gitlab # [ 239.622225] gitaly[893]: time="2026-10-04T17:43:28.805Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=19 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z6T64M3WQDCQ8AD43V1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.773" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 239.662222] gitaly[893]: time="2026-10-04T17:43:28.807Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=19 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z6T64M3WQDCQ8AD43V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:28.773" grpc.time_ms=32.188 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc1930gitlab # [ 239.663048] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.918Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"18122a86d34770ee0a713d61","created_at":"2026-10-04T17:43:28.916Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"68d417bec7218c77b286302f","job_size_bytes":3,"pid":2488,"job_status":"deduplicated","message":"PipelineProcessWorker JID-18122a86d34770ee0a713d61: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1931gitlab # [ 239.663663] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.919Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"68d417bec7218c77b286302f","created_at":"2026-10-04T17:43:28.608Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-becd8b0356644f46","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.611Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-68d417bec7218c77b286302f: rescheduled"}1932gitlab # [ 239.709072] gitaly[893]: time="2026-10-04T17:43:28.811Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406Z88ARF9K1JPWGAVCCS2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:58.710" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.810" grpc.time_ms=0.389 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 239.709748] gitaly[893]: time="2026-10-04T17:43:28.815Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:28.815" grpc.time_ms=0.28 pid=893 span.kind=server system=grpc1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65'1935gitlab # [ 239.710257] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.923Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"68d417bec7218c77b286302f","created_at":"2026-10-04T17:43:28.608Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-becd8b0356644f46","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.611Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68d417bec7218c77b286302f: done: 0.241982 sec","job_status":"done","queue_duration_s":0.070011,"scheduling_latency_s":0.070025,"gitaly_calls":3,"gitaly_duration_s":0.097237,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014353,"redis_read_bytes":226,"redis_write_bytes":18464,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001305,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00188,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002278,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004996,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000146,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000686,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096544,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.189372951,"duration_s":0.241982,"completed_at":"2026-10-04T17:43:28.923Z","load_balancing_strategy":"primary","db_duration_s":0.035182,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1936gitlab # [ 239.756971] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.924Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"39cbf106229d55bf1889e1f2","created_at":"2026-10-04T17:43:28.722Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.726Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-39cbf106229d55bf1889e1f2: start","job_status":"start","queue_duration_s":0.197596,"scheduling_latency_s":0.197614}1937gitlab # [ 239.757812] gitaly[893]: time="2026-10-04T17:43:28.824Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH diskcache=76ea5585-de15-49a1-98c9-fbd93eb27043 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:58.733" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.733" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65', in 0.06 seconds)1939(finished: subtest: push delivers the webhook, in 43.31 seconds)1940subtest: eval and build post commit statuses1941gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses1942gitlab # [ 239.795248] gitaly[893]: time="2026-10-04T17:43:28.824Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=55 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6974 command.oublock=0 command.real_time_ms=84 command.spawn_token_fork_ms=1 command.system_time_ms=42 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:58.733" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.733" grpc.time_ms=91.543 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 239.796277] nixbot[2612]: {"ts": "2026-10-04T17:43:29.009Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 \"HTTP/1.1 201 Created\""}1944gitlab # [ 239.796708] nixbot[2612]: {"ts": "2026-10-04T17:43:29.014Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1bac1bdf0584-4"}1945gitlab # [ 239.798623] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.950Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"39cbf106229d55bf1889e1f2","created_at":"2026-10-04T17:43:28.722Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.726Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-39cbf106229d55bf1889e1f2: done: 0.026283 sec","job_status":"done","queue_duration_s":0.197596,"scheduling_latency_s":0.197614,"redis_calls":7,"redis_duration_s":0.0011380000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026283,"completed_at":"2026-10-04T17:43:28.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005242,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1946gitlab # [ 239.841036] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.951Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a83c9683c28dffe4b78b566b","created_at":"2026-10-04T17:43:28.829Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.831Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a83c9683c28dffe4b78b566b: start","job_status":"start","queue_duration_s":0.120415,"scheduling_latency_s":0.12043}1947gitlab # [ 239.841789] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 1731948gitlab # [ 239.842212] gitaly[893]: time="2026-10-04T17:43:28.862Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:58.861" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.861" grpc.time_ms=0.55 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 239.880568] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.967Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"a83c9683c28dffe4b78b566b","created_at":"2026-10-04T17:43:28.829Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.831Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-a83c9683c28dffe4b78b566b: done: 0.015852 sec","job_status":"done","queue_duration_s":0.120415,"scheduling_latency_s":0.12043,"redis_calls":7,"redis_duration_s":0.000994,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015852,"completed_at":"2026-10-04T17:43:28.967Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1950gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.11 seconds)1951gitlab # [ 239.881551] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.968Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"058892191d40fd4f10713a88","created_at":"2026-10-04T17:43:28.836Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.838Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-058892191d40fd4f10713a88: start","job_status":"start","queue_duration_s":0.129968,"scheduling_latency_s":0.129982}1952gitlab # [ 239.921179] nixbot[2612]: INFO: ::ffff:127.0.0.1:45264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 200 OK1953gitlab # [ 239.921869] nixbot[2612]: {"ts": "2026-10-04T17:43:29.137Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1bac1bdf0584-4", "argv0": "bwrap"}1954gitlab # [ 239.922528] gitaly[893]: time="2026-10-04T17:43:28.866Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:58.466" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.866" grpc.time_ms=0.27 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 239.923214] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.992Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"058892191d40fd4f10713a88","created_at":"2026-10-04T17:43:28.836Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.838Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-058892191d40fd4f10713a88: done: 0.024025 sec","job_status":"done","queue_duration_s":0.129968,"scheduling_latency_s":0.129982,"redis_calls":7,"redis_duration_s":0.0011459999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024025,"completed_at":"2026-10-04T17:43:28.992Z","load_balancing_strategy":"primary","db_duration_s":0.007476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 239.964597] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:28.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"47f837e96acfe215cf46150f","created_at":"2026-10-04T17:43:28.844Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.845Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-47f837e96acfe215cf46150f: start","job_status":"start","queue_duration_s":0.147529,"scheduling_latency_s":0.147547}1957gitlab # [ 239.965241] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 861958gitlab # [ 239.965698] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4211959gitlab # [ 239.966170] gitaly[893]: time="2026-10-04T17:43:28.877Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-04T17:43:58.470" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.870" grpc.time_ms=6.589 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 240.006852] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.011Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"47f837e96acfe215cf46150f","created_at":"2026-10-04T17:43:28.844Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.845Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-47f837e96acfe215cf46150f: done: 0.018576 sec","job_status":"done","queue_duration_s":0.147529,"scheduling_latency_s":0.147547,"redis_calls":10,"redis_duration_s":0.001363,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000395,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018576,"completed_at":"2026-10-04T17:43:29.011Z","load_balancing_strategy":"primary","db_duration_s":0.00256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1961gitlab # [ 240.046236] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.012Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"77e8690025349f4060cf6d2a","created_at":"2026-10-04T17:43:28.846Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.847Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-77e8690025349f4060cf6d2a: start","job_status":"start","queue_duration_s":0.165409,"scheduling_latency_s":0.165421}1962gitlab # [ 240.046975] gitaly[893]: time="2026-10-04T17:43:28.885Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:58.884" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.885" grpc.time_ms=0.367 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 240.047593] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.030Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"77e8690025349f4060cf6d2a","created_at":"2026-10-04T17:43:28.846Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.847Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-77e8690025349f4060cf6d2a: done: 0.017277 sec","job_status":"done","queue_duration_s":0.165409,"scheduling_latency_s":0.165421,"redis_calls":7,"redis_duration_s":0.001064,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017277,"completed_at":"2026-10-04T17:43:29.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 240.100706] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.030Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a87d3598bcb37dffd4fe13d","created_at":"2026-10-04T17:43:28.847Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.849Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a87d3598bcb37dffd4fe13d: start","job_status":"start","queue_duration_s":0.181887,"scheduling_latency_s":0.181901}1965gitlab # [ 240.101485] gitaly[893]: time="2026-10-04T17:43:28.889Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:38.183" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.883" grpc.time_ms=5.088 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 240.103225] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a87d3598bcb37dffd4fe13d","created_at":"2026-10-04T17:43:28.847Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.849Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a87d3598bcb37dffd4fe13d: done: 0.01659 sec","job_status":"done","queue_duration_s":0.181887,"scheduling_latency_s":0.181901,"redis_calls":8,"redis_duration_s":0.001583,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01659,"completed_at":"2026-10-04T17:43:29.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004032,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967gitlab # [ 240.150948] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.048Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"88590122ac735c6195cf9445","created_at":"2026-10-04T17:43:28.849Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.850Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-88590122ac735c6195cf9445: start","job_status":"start","queue_duration_s":0.197995,"scheduling_latency_s":0.19801}1968gitlab # [ 240.192847] gitaly[893]: time="2026-10-04T17:43:28.902Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-04T17:43:38.201" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:28.901" grpc.time_ms=0.148 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 240.193608] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.068Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"88590122ac735c6195cf9445","created_at":"2026-10-04T17:43:28.849Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.850Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-88590122ac735c6195cf9445: done: 0.019894 sec","job_status":"done","queue_duration_s":0.197995,"scheduling_latency_s":0.19801,"redis_calls":7,"redis_duration_s":0.004337,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003048,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019894,"completed_at":"2026-10-04T17:43:29.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1970gitlab # [ 240.235305] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.069Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"471ef82c30ee7d5152df53f7","created_at":"2026-10-04T17:43:28.850Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.851Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-471ef82c30ee7d5152df53f7: start","job_status":"start","queue_duration_s":0.217632,"scheduling_latency_s":0.217647}1971gitlab # [ 240.236067] gitaly[893]: time="2026-10-04T17:43:28.909Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=617 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-04T17:43:38.204" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:28.904" grpc.time_ms=4.729 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 240.236644] gitaly[893]: time="2026-10-04T17:43:28.938Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:28.938" grpc.time_ms=0.313 pid=893 span.kind=server system=grpc1973gitlab # [ 240.238496] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.087Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"471ef82c30ee7d5152df53f7","created_at":"2026-10-04T17:43:28.850Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.851Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-471ef82c30ee7d5152df53f7: done: 0.018615 sec","job_status":"done","queue_duration_s":0.217632,"scheduling_latency_s":0.217647,"redis_calls":7,"redis_duration_s":0.000994,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018615,"completed_at":"2026-10-04T17:43:29.087Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1974gitlab # [ 240.293066] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.088Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"163d7190d9fbce6d02e706d0","created_at":"2026-10-04T17:43:28.852Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.852Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-163d7190d9fbce6d02e706d0: start","job_status":"start","queue_duration_s":0.23601,"scheduling_latency_s":0.236024}1975gitlab # [ 240.293760] gitaly[893]: time="2026-10-04T17:43:28.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:28.954" grpc.time_ms=0.219 pid=893 span.kind=server system=grpc1976gitlab # [ 240.299063] gitaly[893]: time="2026-10-04T17:43:28.962Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK diskcache=dcfc144c-0c1f-4590-8296-5ebaea23bacd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T17:43:38.210" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:28.910" pid=893 ref=refs/keep-around/1bac1bdf058413228a5e5ffe12ebe66f522aca65 remote_ip="2001:db8:1::1" revision=1bac1bdf058413228a5e5ffe12ebe66f522aca65 span.kind=server system=grpc username=root1977gitlab # [ 240.309662] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"163d7190d9fbce6d02e706d0","created_at":"2026-10-04T17:43:28.852Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.852Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-163d7190d9fbce6d02e706d0: done: 0.008174 sec","job_status":"done","queue_duration_s":0.23601,"scheduling_latency_s":0.236024,"redis_calls":7,"redis_duration_s":0.00087,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008174,"completed_at":"2026-10-04T17:43:29.096Z","load_balancing_strategy":"primary","db_duration_s":0.00021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1978gitlab # [ 240.364682] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"38058d4240d4f0a95027d56c","created_at":"2026-10-04T17:43:28.853Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.853Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-38058d4240d4f0a95027d56c: start","job_status":"start","queue_duration_s":0.243903,"scheduling_latency_s":0.243915}1979gitlab # [ 240.365463] gitaly[893]: time="2026-10-04T17:43:28.963Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=40 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5189 command.oublock=8 command.real_time_ms=46 command.spawn_token_fork_ms=0 command.system_time_ms=25 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-04T17:43:38.210" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-04T17:43:28.910" grpc.time_ms=52.744 pid=893 ref=refs/keep-around/1bac1bdf058413228a5e5ffe12ebe66f522aca65 remote_ip="2001:db8:1::1" revision=1bac1bdf058413228a5e5ffe12ebe66f522aca65 span.kind=server system=grpc username=root1980gitlab # [ 240.373164] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.114Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"38058d4240d4f0a95027d56c","created_at":"2026-10-04T17:43:28.853Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.853Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-38058d4240d4f0a95027d56c: done: 0.016663 sec","job_status":"done","queue_duration_s":0.243903,"scheduling_latency_s":0.243915,"redis_calls":7,"redis_duration_s":0.000969,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016663,"completed_at":"2026-10-04T17:43:29.114Z","load_balancing_strategy":"primary","db_duration_s":0.005183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 240.435495] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.115Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"670baf58f0ab9ef936b78b7e","created_at":"2026-10-04T17:43:28.919Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.920Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-670baf58f0ab9ef936b78b7e: start","job_status":"start","queue_duration_s":0.195084,"scheduling_latency_s":0.195098}1982gitlab # [ 240.436263] gitaly[893]: time="2026-10-04T17:43:28.965Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:58.564" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:28.965" grpc.time_ms=0.227 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 240.436862] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.202Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7b3bf130fcc266dffaaa22ce","created_at":"2026-10-04T17:43:29.201Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-a255190900d24420","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"670baf58f0ab9ef936b78b7e","job_size_bytes":3,"pid":2488,"job_status":"deduplicated","message":"PipelineProcessWorker JID-7b3bf130fcc266dffaaa22ce: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1984gitlab # [ 240.482034] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.203Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"670baf58f0ab9ef936b78b7e","created_at":"2026-10-04T17:43:28.919Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.920Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-670baf58f0ab9ef936b78b7e: rescheduled"}1985gitlab # [ 240.482653] gitaly[893]: time="2026-10-04T17:43:29.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZJ8RV1NX79WY0SD19A2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:59.159" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.159" grpc.time_ms=0.316 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 240.483419] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"670baf58f0ab9ef936b78b7e","created_at":"2026-10-04T17:43:28.919Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-c92a0febc07e4686","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.920Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-670baf58f0ab9ef936b78b7e: done: 0.092288 sec","job_status":"done","queue_duration_s":0.195084,"scheduling_latency_s":0.195098,"gitaly_calls":2,"gitaly_duration_s":0.004093,"redis_calls":37,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004683,"redis_read_bytes":139,"redis_write_bytes":6671,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00075,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000408,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":4,"redis_queues_duration_s":0.000393,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2221,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":89,"redis_queues_metadata_write_bytes":1432,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000179,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000146,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056302,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070379894,"duration_s":0.092288,"completed_at":"2026-10-04T17:43:29.207Z","load_balancing_strategy":"primary","db_duration_s":0.026544,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1987gitlab # [ 240.540276] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.208Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"06bda5396db03045e722fa36","created_at":"2026-10-04T17:43:28.966Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-8e52a00cfc5d44b6","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.968Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-06bda5396db03045e722fa36: start","job_status":"start","queue_duration_s":0.240458,"scheduling_latency_s":0.240472}1988gitlab # [ 240.541026] gitaly[893]: time="2026-10-04T17:43:29.160Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406Z88ARF9K1JPWGAVCCS2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:39.114" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.154" grpc.time_ms=5.373 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989gitlab # [ 240.544197] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.225Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"06bda5396db03045e722fa36","created_at":"2026-10-04T17:43:28.966Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-8e52a00cfc5d44b6","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.968Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-06bda5396db03045e722fa36: done: 0.016457 sec","job_status":"done","queue_duration_s":0.240458,"scheduling_latency_s":0.240472,"redis_calls":7,"redis_duration_s":0.0008830000000000001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016457,"completed_at":"2026-10-04T17:43:29.225Z","load_balancing_strategy":"primary","db_duration_s":0.002651,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1990gitlab # [ 240.582571] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.226Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"90b5951ebb9dc20bd442ab93","created_at":"2026-10-04T17:43:28.968Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-8e52a00cfc5d44b6","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.969Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-90b5951ebb9dc20bd442ab93: start","job_status":"start","queue_duration_s":0.256397,"scheduling_latency_s":0.25641}1991gitlab # [ 240.598138] gitaly[893]: time="2026-10-04T17:43:29.176Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:59.175" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.176" grpc.time_ms=0.425 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 240.637102] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.306Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"90b5951ebb9dc20bd442ab93","created_at":"2026-10-04T17:43:28.968Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-8e52a00cfc5d44b6","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:28.969Z","job_size_bytes":65,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-90b5951ebb9dc20bd442ab93: done: 0.080818 sec","job_status":"done","queue_duration_s":0.256397,"scheduling_latency_s":0.25641,"redis_calls":10,"redis_duration_s":0.001598,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080818,"completed_at":"2026-10-04T17:43:29.306Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 240.647617] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.307Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2a38d17990c392f0d62a03f9","created_at":"2026-10-04T17:43:28.998Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-8e52a00cfc5d44b6","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.000Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2a38d17990c392f0d62a03f9: start","job_status":"start","queue_duration_s":0.307543,"scheduling_latency_s":0.307559}1994gitlab # [ 240.661696] gitaly[893]: time="2026-10-04T17:43:29.197Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:59.196" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.196" grpc.time_ms=0.456 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 240.672761] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.379Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2a38d17990c392f0d62a03f9","created_at":"2026-10-04T17:43:28.998Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-8e52a00cfc5d44b6","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.000Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2a38d17990c392f0d62a03f9: done: 0.071276 sec","job_status":"done","queue_duration_s":0.307543,"scheduling_latency_s":0.307559,"gitaly_calls":2,"gitaly_duration_s":0.003631,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003652,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000537,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000565,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000161,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000129,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000251,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000599,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051727,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05329141,"duration_s":0.071276,"completed_at":"2026-10-04T17:43:29.379Z","load_balancing_strategy":"primary","db_duration_s":0.015223,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1996gitlab # [ 240.717570] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b679ffad551ecf709b32ce3d","created_at":"2026-10-04T17:43:29.162Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-a255190900d24420","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.164Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b679ffad551ecf709b32ce3d: start","job_status":"start","queue_duration_s":0.215741,"scheduling_latency_s":0.215754}1997gitlab # [ 240.731868] gitaly[893]: time="2026-10-04T17:43:29.352Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:59.351" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.351" grpc.time_ms=0.598 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 240.776124] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.399Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b679ffad551ecf709b32ce3d","created_at":"2026-10-04T17:43:29.162Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-a255190900d24420","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.164Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b679ffad551ecf709b32ce3d: done: 0.019019 sec","job_status":"done","queue_duration_s":0.215741,"scheduling_latency_s":0.215754,"redis_calls":7,"redis_duration_s":0.000825,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019019,"completed_at":"2026-10-04T17:43:29.399Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 240.779870] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.400Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"974ad708653cea87139a60e8","created_at":"2026-10-04T17:43:29.203Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-a255190900d24420","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.204Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-974ad708653cea87139a60e8: start","job_status":"start","queue_duration_s":0.195748,"scheduling_latency_s":0.195761}2000gitlab # [ 240.793879] gitaly[893]: time="2026-10-04T17:43:29.372Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406ZA2JKYAWDPB03X5D9HK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:59.371" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.372" grpc.time_ms=0.399 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 240.805143] gitaly[893]: time="2026-10-04T17:43:29.460Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:29.460" grpc.time_ms=0.25 pid=893 span.kind=server system=grpc2002gitlab # [ 240.813739] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.573Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"974ad708653cea87139a60e8","created_at":"2026-10-04T17:43:29.203Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-a255190900d24420","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.204Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-974ad708653cea87139a60e8: done: 0.172926 sec","job_status":"done","queue_duration_s":0.195748,"scheduling_latency_s":0.195761,"gitaly_calls":3,"gitaly_duration_s":0.072718,"redis_calls":71,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007611,"redis_read_bytes":152,"redis_write_bytes":19877,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000528,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000553,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":23,"redis_queues_duration_s":0.001762,"redis_queues_read_bytes":26,"redis_queues_write_bytes":13379,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.00266,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000128,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000473,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078204,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.155112452,"duration_s":0.172926,"completed_at":"2026-10-04T17:43:29.573Z","load_balancing_strategy":"primary","db_duration_s":0.019811,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2003gitlab # [ 240.868701] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"14ce4ca45e13dce4179161c5","created_at":"2026-10-04T17:43:29.342Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-4c6d04b5a166489e","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.343Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-14ce4ca45e13dce4179161c5: start","job_status":"start","queue_duration_s":0.231072,"scheduling_latency_s":0.231086}2004gitlab # [ 240.872744] gitaly[893]: time="2026-10-04T17:43:29.478Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:29.477" grpc.time_ms=0.203 pid=893 span.kind=server system=grpc2005gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2006gitlab # [ 240.881140] gitaly[893]: time="2026-10-04T17:43:29.493Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:29.493" grpc.time_ms=0.299 pid=893 span.kind=server system=grpc2007gitlab # [ 240.889892] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"14ce4ca45e13dce4179161c5","created_at":"2026-10-04T17:43:29.342Z","trace_propagation_headers":{"sentry-trace":"74e8eaad8c0f4d9faedb3309f419c898-4c6d04b5a166489e","baggage":"sentry-trace_id=74e8eaad8c0f4d9faedb3309f419c898,sentry-release=Unknown"},"correlation_id":"01M4406ZA2JKYAWDPB03X5D9HK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.343Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-14ce4ca45e13dce4179161c5: done: 0.019582 sec","job_status":"done","queue_duration_s":0.231072,"scheduling_latency_s":0.231086,"redis_calls":7,"redis_duration_s":0.0008060000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019582,"completed_at":"2026-10-04T17:43:29.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 240.932685] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8ec458dbd55cb9fbb27c64f4","created_at":"2026-10-04T17:43:29.438Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.439Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8ec458dbd55cb9fbb27c64f4: start","job_status":"start","queue_duration_s":0.156311,"scheduling_latency_s":0.156324}2009gitlab # [ 240.940707] gitaly[893]: time="2026-10-04T17:43:29.496Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:59.442" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.442" operations="[repack_refs]" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 240.948621] gitaly[893]: time="2026-10-04T17:43:29.497Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:59.442" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.442" pid=893 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-04 17:42:34.476606224 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2011gitlab # [ 240.959684] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8ec458dbd55cb9fbb27c64f4","created_at":"2026-10-04T17:43:29.438Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.439Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8ec458dbd55cb9fbb27c64f4: done: 0.022777 sec","job_status":"done","queue_duration_s":0.156311,"scheduling_latency_s":0.156324,"redis_calls":7,"redis_duration_s":0.000812,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000211,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022777,"completed_at":"2026-10-04T17:43:29.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004257,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2012gitlab # [ 241.006559] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.619Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c7555a1a5007401a74939b65","created_at":"2026-10-04T17:43:29.514Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.516Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c7555a1a5007401a74939b65: start","job_status":"start","queue_duration_s":0.103588,"scheduling_latency_s":0.103601}2013gitlab # [ 241.011653] gitaly[893]: time="2026-10-04T17:43:29.508Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH diskcache=b226dba4-73df-4587-a76e-4f7c312a8f07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:59.442" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.442" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.15 seconds)2015gitlab # [ 241.020209] gitaly[893]: time="2026-10-04T17:43:29.508Z" level=info msg="finished unary call with code OK" command.count=4 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7944 command.oublock=0 command.real_time_ms=60 command.spawn_token_fork_ms=0 command.system_time_ms=37 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:59.442" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.442" grpc.time_ms=66.125 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 241.031884] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c7555a1a5007401a74939b65","created_at":"2026-10-04T17:43:29.514Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.516Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c7555a1a5007401a74939b65: done: 0.015137 sec","job_status":"done","queue_duration_s":0.103588,"scheduling_latency_s":0.103601,"redis_calls":7,"redis_duration_s":0.000787,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00021,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015137,"completed_at":"2026-10-04T17:43:29.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2017gitlab # [ 241.073643] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.635Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e863bccae97cefa19dfe236b","created_at":"2026-10-04T17:43:29.521Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.522Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e863bccae97cefa19dfe236b: start","job_status":"start","queue_duration_s":0.113438,"scheduling_latency_s":0.113451}2018gitlab # [ 241.082979] gitaly[893]: time="2026-10-04T17:43:29.510Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:59.442" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.442" pid=893 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2019gitlab # [ 241.119675] gitaly[893]: time="2026-10-04T17:43:29.510Z" level=info msg="optimized repository" clean_stale_data_time=12.354922ms clean_work_trees_time="102.527µs" commit_graph_time="3.632µs" correlation_id=01M4406YZM0SD5A9HXBTN0EEXH gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.191µs" pid=893 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="10.895µs" storage_name=default system=housekeeping total_time=12.568916ms2020gitlab # [ 241.120681] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1042021gitlab # [ 241.121232] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e863bccae97cefa19dfe236b","created_at":"2026-10-04T17:43:29.521Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.522Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e863bccae97cefa19dfe236b: done: 0.015689 sec","job_status":"done","queue_duration_s":0.113438,"scheduling_latency_s":0.113451,"redis_calls":7,"redis_duration_s":0.000905,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015689,"completed_at":"2026-10-04T17:43:29.651Z","load_balancing_strategy":"primary","db_duration_s":0.002417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2022gitlab # [ 241.174361] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e18d68eb34a9762c2cb6c5d2","created_at":"2026-10-04T17:43:29.527Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.528Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e18d68eb34a9762c2cb6c5d2: start","job_status":"start","queue_duration_s":0.123818,"scheduling_latency_s":0.123831}2023gitlab # [ 241.175105] gitaly[893]: time="2026-10-04T17:43:29.510Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:43:59.442" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:29.442" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 241.175795] gitaly[893]: time="2026-10-04T17:43:29.547Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:43:59.546" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.546" grpc.time_ms=0.521 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 241.176411] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.671Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e18d68eb34a9762c2cb6c5d2","created_at":"2026-10-04T17:43:29.527Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.528Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e18d68eb34a9762c2cb6c5d2: done: 0.019288 sec","job_status":"done","queue_duration_s":0.123818,"scheduling_latency_s":0.123831,"redis_calls":10,"redis_duration_s":0.001219,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019288,"completed_at":"2026-10-04T17:43:29.671Z","load_balancing_strategy":"primary","db_duration_s":0.003447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2026gitlab # [ 241.216173] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f999bb9da8e34a339c931597","created_at":"2026-10-04T17:43:29.528Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.529Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f999bb9da8e34a339c931597: start","job_status":"start","queue_duration_s":0.14273,"scheduling_latency_s":0.142744}2027gitlab # [ 241.222786] gitaly[893]: time="2026-10-04T17:43:29.566Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4406YZM0SD5A9HXBTN0EEXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:43:59.565" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:29.565" grpc.time_ms=0.372 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 241.261961] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.686Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f999bb9da8e34a339c931597","created_at":"2026-10-04T17:43:29.528Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.529Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f999bb9da8e34a339c931597: done: 0.014362 sec","job_status":"done","queue_duration_s":0.14273,"scheduling_latency_s":0.142744,"redis_calls":7,"redis_duration_s":0.000797,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000204,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014362,"completed_at":"2026-10-04T17:43:29.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 241.270709] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c20f53e846df90495878b30a","created_at":"2026-10-04T17:43:29.529Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.531Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c20f53e846df90495878b30a: start","job_status":"start","queue_duration_s":0.156296,"scheduling_latency_s":0.156309}2030gitlab # [ 241.284988] gitaly[893]: time="2026-10-04T17:43:30.315Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44070NJ8912XTSB3BA0NN77 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:00.314" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:30.314" grpc.time_ms=0.472 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 241.296564] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c20f53e846df90495878b30a","created_at":"2026-10-04T17:43:29.529Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.531Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c20f53e846df90495878b30a: done: 0.013567 sec","job_status":"done","queue_duration_s":0.156296,"scheduling_latency_s":0.156309,"redis_calls":8,"redis_duration_s":0.00089,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000207,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013567,"completed_at":"2026-10-04T17:43:29.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2032gitlab # [ 241.335646] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.701Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e5c19016b51d496f900782e9","created_at":"2026-10-04T17:43:29.531Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.532Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e5c19016b51d496f900782e9: start","job_status":"start","queue_duration_s":0.169189,"scheduling_latency_s":0.169202}2033gitlab # [ 241.348694] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.714Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e5c19016b51d496f900782e9","created_at":"2026-10-04T17:43:29.531Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.532Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e5c19016b51d496f900782e9: done: 0.012169 sec","job_status":"done","queue_duration_s":0.169189,"scheduling_latency_s":0.169202,"redis_calls":7,"redis_duration_s":0.000781,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00021,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012169,"completed_at":"2026-10-04T17:43:29.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2034gitlab # [ 241.387134] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"db80c01752f52f2694bc935b","created_at":"2026-10-04T17:43:29.533Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.534Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-db80c01752f52f2694bc935b: start","job_status":"start","queue_duration_s":0.180365,"scheduling_latency_s":0.180378}2035gitlab # [ 241.438097] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"db80c01752f52f2694bc935b","created_at":"2026-10-04T17:43:29.533Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.534Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-db80c01752f52f2694bc935b: done: 0.01821 sec","job_status":"done","queue_duration_s":0.180365,"scheduling_latency_s":0.180378,"redis_calls":7,"redis_duration_s":0.0008,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000209,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01821,"completed_at":"2026-10-04T17:43:29.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2036gitlab # [ 241.439110] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.734Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f3a6b95ac4fadf0b756a2d13","created_at":"2026-10-04T17:43:29.536Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.537Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f3a6b95ac4fadf0b756a2d13: start","job_status":"start","queue_duration_s":0.196419,"scheduling_latency_s":0.196432}2037gitlab # [ 241.452628] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.748Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f3a6b95ac4fadf0b756a2d13","created_at":"2026-10-04T17:43:29.536Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.537Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f3a6b95ac4fadf0b756a2d13: done: 0.014524 sec","job_status":"done","queue_duration_s":0.196419,"scheduling_latency_s":0.196432,"redis_calls":7,"redis_duration_s":0.000812,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000213,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014524,"completed_at":"2026-10-04T17:43:29.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2038gitlab # [ 241.518031] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a8b7229743ac93406fa5fa13","created_at":"2026-10-04T17:43:29.537Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.538Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a8b7229743ac93406fa5fa13: start","job_status":"start","queue_duration_s":0.210627,"scheduling_latency_s":0.21064}2039gitlab # [ 241.518778] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a8b7229743ac93406fa5fa13","created_at":"2026-10-04T17:43:29.537Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.538Z","job_size_bytes":6,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a8b7229743ac93406fa5fa13: done: 0.008295 sec","job_status":"done","queue_duration_s":0.210627,"scheduling_latency_s":0.21064,"redis_calls":7,"redis_duration_s":0.0007999999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000216,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008295,"completed_at":"2026-10-04T17:43:29.757Z","load_balancing_strategy":"primary","db_duration_s":0.000327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2040gitlab # [ 241.563946] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"423a78e077e2141c5a76426d","created_at":"2026-10-04T17:43:29.538Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.539Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-423a78e077e2141c5a76426d: start","job_status":"start","queue_duration_s":0.218588,"scheduling_latency_s":0.2186}2041gitlab # [ 241.564702] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:29.770Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"423a78e077e2141c5a76426d","created_at":"2026-10-04T17:43:29.538Z","trace_propagation_headers":{"sentry-trace":"541e39c9a29642c086a901cfb8bba052-47c8c9857935465a","baggage":"sentry-trace_id=541e39c9a29642c086a901cfb8bba052,sentry-release=Unknown"},"correlation_id":"01M4406YZM0SD5A9HXBTN0EEXH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:29.539Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-423a78e077e2141c5a76426d: done: 0.012401 sec","job_status":"done","queue_duration_s":0.218588,"scheduling_latency_s":0.2186,"redis_calls":7,"redis_duration_s":0.0007899999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012401,"completed_at":"2026-10-04T17:43:29.770Z","load_balancing_strategy":"primary","db_duration_s":0.001754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2042gitlab # [ 241.643598] nixbot[2612]: {"ts": "2026-10-04T17:43:30.907Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f86e5237bc7eb58df9207963e6720fdd3be7b2c9 \"HTTP/1.1 201 Created\""}2043gitlab # [ 241.688754] nix-daemon[2777]: accepted connection from pid 3582, user nixbot2044gitlab # [ 241.718578] gitaly[893]: time="2026-10-04T17:43:30.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M44071BHWQJ2MS0N385EYF4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:30.976" grpc.time_ms=5.829 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc2045gitlab # [ 241.719556] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 532046gitlab # [ 241.785180] gitaly[893]: time="2026-10-04T17:43:31.048Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M44071DT8W0Z8A04E6CHZAX7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:31.040" pid=893 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2047gitlab # [ 241.785915] gitaly[893]: time="2026-10-04T17:43:31.049Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M44071DT8W0Z8A04E6CHZAX7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:31.040" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc2048gitlab # [ 241.829582] gitaly[893]: time="2026-10-04T17:43:31.093Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M44071DT8W0Z8A04E6CHZAX7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-04T17:43:31.040" grpc.time_ms=52.734 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc2049gitlab # [ 241.830283] gitlab-workhorse[826]: time="2026-10-04T17:43:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672050gitlab # [ 241.830686] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 912051gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2052gitlab # [ 242.169468] gitaly[893]: time="2026-10-04T17:43:31.433Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44071SHS9B1T7S9JSZDTAPX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:01.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:31.432" grpc.time_ms=0.662 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 242.220875] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1062054gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.16 seconds)2055gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2056gitlab # [ 243.316839] gitaly[893]: time="2026-10-04T17:43:32.580Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44072XCQBJPBZN0Y1WVWJAV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:02.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:32.579" grpc.time_ms=0.96 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 243.340412] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 792058gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.12 seconds)2059gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2060gitlab # [ 244.447327] gitaly[893]: time="2026-10-04T17:43:33.710Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M440740FMVKQPW3J5J1NTXBJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:03.308" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:33.709" grpc.time_ms=0.9 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 244.477712] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 922062gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.13 seconds)2063gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2064gitlab # [ 245.571582] gitaly[893]: time="2026-10-04T17:43:34.834Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M440753XJVRKSTB3DW9C4V7Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:04.433" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:34.833" grpc.time_ms=0.888 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.11 seconds)2066gitlab # [ 245.600428] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 762067gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2068gitlab # [ 246.689800] gitaly[893]: time="2026-10-04T17:43:35.953Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M440766RYTKWT2N1BDYH6XXW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:05.551" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:35.952" grpc.time_ms=0.851 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 246.746983] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1132070gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.15 seconds)2071gitlab # [ 246.753211] nix-daemon[2777]: accepted connection from pid 3646, user nixbot2072gitlab # [ 246.763072] nix-daemon[2777]: accepted connection from pid 3582, user nixbot2073gitlab # [ 246.850074] gitaly[893]: time="2026-10-04T17:43:36.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:06.112" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.113" grpc.time_ms=0.814 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 246.919564] gitaly[893]: time="2026-10-04T17:43:36.183Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:46.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.172" grpc.time_ms=10.543 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 246.961135] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.224Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d2ce50e02a47e2b8485c904a","created_at":"2026-10-04T17:43:36.218Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-fc5df3b186364e57","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.222Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d2ce50e02a47e2b8485c904a: start","job_status":"start","queue_duration_s":0.001586,"scheduling_latency_s":0.001616}2076gitlab # [ 247.006082] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2062077gitlab # [ 247.009482] nixbot[2612]: {"ts": "2026-10-04T17:43:36.273Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 \"HTTP/1.1 201 Created\""}2078gitlab # [ 247.057688] gitaly[893]: time="2026-10-04T17:43:36.321Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:36.321" grpc.time_ms=0.322 pid=893 span.kind=server system=grpc2079gitlab # [ 247.062725] gitaly[893]: time="2026-10-04T17:43:36.326Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44076JMJ7DT25MEJ5PCXAXG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:06.325" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.326" grpc.time_ms=0.52 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 247.090821] gitaly[893]: time="2026-10-04T17:43:36.354Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M44076JMJ7DT25MEJ5PCXAXG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:46.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.349" grpc.time_ms=5.317 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 247.120093] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1052082gitlab # [ 247.123088] nixbot[2612]: {"ts": "2026-10-04T17:43:36.383Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 \"HTTP/1.1 201 Created\""}2083gitlab # [ 247.126913] gitaly[893]: time="2026-10-04T17:43:36.391Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:36.390" grpc.time_ms=0.324 pid=893 span.kind=server system=grpc2084gitlab # [ 247.153728] gitaly[893]: time="2026-10-04T17:43:36.417Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:36.417" grpc.time_ms=0.333 pid=893 span.kind=server system=grpc2085gitlab # [ 247.170053] gitaly[893]: time="2026-10-04T17:43:36.434Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44076PJRV6X565SGPQA7FHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:06.433" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.433" grpc.time_ms=0.488 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 247.177958] gitaly[893]: time="2026-10-04T17:43:36.442Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK diskcache=10a878d1-f948-44d7-b589-9e43b8853eb2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:44:06.299" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.299" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 247.178676] gitaly[893]: time="2026-10-04T17:43:36.442Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=172 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7253 command.oublock=0 command.real_time_ms=130 command.spawn_token_fork_ms=0 command.system_time_ms=132 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:44:06.299" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.299" grpc.time_ms=142.538 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 247.216498] gitaly[893]: time="2026-10-04T17:43:36.480Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:44:06.479" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.479" grpc.time_ms=0.674 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 247.229974] gitaly[893]: time="2026-10-04T17:43:36.494Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M44076PJRV6X565SGPQA7FHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-04T17:43:46.288" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.489" grpc.time_ms=4.912 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 247.246894] gitaly[893]: time="2026-10-04T17:43:36.510Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:06.510" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.510" grpc.time_ms=0.442 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 247.265184] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.529Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"84b9a623e8139ec78f81988f","created_at":"2026-10-04T17:43:36.527Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"d2ce50e02a47e2b8485c904a","job_size_bytes":3,"pid":2488,"job_status":"deduplicated","message":"PipelineProcessWorker JID-84b9a623e8139ec78f81988f: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2092gitlab # [ 247.279130] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.530Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d2ce50e02a47e2b8485c904a","created_at":"2026-10-04T17:43:36.218Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-fc5df3b186364e57","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.222Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2488,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d2ce50e02a47e2b8485c904a: rescheduled"}2093gitlab # [ 247.292769] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.535Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d2ce50e02a47e2b8485c904a","created_at":"2026-10-04T17:43:36.218Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-fc5df3b186364e57","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.222Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d2ce50e02a47e2b8485c904a: done: 0.311692 sec","job_status":"done","queue_duration_s":0.001586,"scheduling_latency_s":0.001616,"gitaly_calls":3,"gitaly_duration_s":0.171183,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011689999999999999,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001218,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000957,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002448,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003899,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000232,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000353,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106303,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.281316201,"duration_s":0.311692,"completed_at":"2026-10-04T17:43:36.535Z","load_balancing_strategy":"primary","db_duration_s":0.028924,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2094gitlab # [ 247.333312] nixbot[2612]: {"ts": "2026-10-04T17:43:36.540Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 \"HTTP/1.1 201 Created\""}2095gitlab # [ 247.333963] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/10/04:17:43:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1bac1bdf058413228a5e5ffe12ebe66f522aca65 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1372096gitlab # [ 247.334582] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.537Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"85cfe2d2d3c367839c946845","created_at":"2026-10-04T17:43:36.291Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.293Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-85cfe2d2d3c367839c946845: start","job_status":"start","queue_duration_s":0.243014,"scheduling_latency_s":0.243029}2097gitlab # [ 247.335238] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"85cfe2d2d3c367839c946845","created_at":"2026-10-04T17:43:36.291Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.293Z","job_size_bytes":23,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-85cfe2d2d3c367839c946845: done: 0.029707 sec","job_status":"done","queue_duration_s":0.243014,"scheduling_latency_s":0.243029,"redis_calls":7,"redis_duration_s":0.001469,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029707,"completed_at":"2026-10-04T17:43:36.566Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005534,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2098gitlab # [ 247.375136] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.568Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"41c8c34b7d06c83260c8d4b3","created_at":"2026-10-04T17:43:36.446Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.448Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-41c8c34b7d06c83260c8d4b3: start","job_status":"start","queue_duration_s":0.119893,"scheduling_latency_s":0.119911}2099gitlab # [ 247.375854] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.583Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"41c8c34b7d06c83260c8d4b3","created_at":"2026-10-04T17:43:36.446Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.448Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-41c8c34b7d06c83260c8d4b3: done: 0.015855 sec","job_status":"done","queue_duration_s":0.119893,"scheduling_latency_s":0.119911,"redis_calls":7,"redis_duration_s":0.000804,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000222,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015855,"completed_at":"2026-10-04T17:43:36.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 247.408555] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.584Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c2602cc701e5f1b30e54955a","created_at":"2026-10-04T17:43:36.452Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.453Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c2602cc701e5f1b30e54955a: start","job_status":"start","queue_duration_s":0.130752,"scheduling_latency_s":0.130774}2101gitlab # [ 247.422660] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c2602cc701e5f1b30e54955a","created_at":"2026-10-04T17:43:36.452Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.453Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c2602cc701e5f1b30e54955a: done: 0.015917 sec","job_status":"done","queue_duration_s":0.130752,"scheduling_latency_s":0.130774,"redis_calls":7,"redis_duration_s":0.0009,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015917,"completed_at":"2026-10-04T17:43:36.600Z","load_balancing_strategy":"primary","db_duration_s":0.002854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2102gitlab # [ 247.476053] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b6df6063c828e0a9c91f4feb","created_at":"2026-10-04T17:43:36.458Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.459Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b6df6063c828e0a9c91f4feb: start","job_status":"start","queue_duration_s":0.142254,"scheduling_latency_s":0.142267}2103gitlab # [ 247.476742] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b6df6063c828e0a9c91f4feb","created_at":"2026-10-04T17:43:36.458Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.459Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b6df6063c828e0a9c91f4feb: done: 0.016954 sec","job_status":"done","queue_duration_s":0.142254,"scheduling_latency_s":0.142267,"redis_calls":10,"redis_duration_s":0.001248,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000365,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016954,"completed_at":"2026-10-04T17:43:36.618Z","load_balancing_strategy":"primary","db_duration_s":0.002683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2104gitlab # [ 247.527076] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1ffe30b419460c103b3b4228","created_at":"2026-10-04T17:43:36.459Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.460Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1ffe30b419460c103b3b4228: start","job_status":"start","queue_duration_s":0.158831,"scheduling_latency_s":0.158844}2105gitlab # [ 247.527917] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1ffe30b419460c103b3b4228","created_at":"2026-10-04T17:43:36.459Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.460Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1ffe30b419460c103b3b4228: done: 0.014397 sec","job_status":"done","queue_duration_s":0.158831,"scheduling_latency_s":0.158844,"redis_calls":7,"redis_duration_s":0.000852,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014397,"completed_at":"2026-10-04T17:43:36.633Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2106gitlab # [ 247.571770] gitaly[893]: time="2026-10-04T17:43:36.775Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:36.775" grpc.time_ms=0.313 pid=893 span.kind=server system=grpc2107gitlab # [ 247.572584] gitaly[893]: time="2026-10-04T17:43:36.793Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:36.793" grpc.time_ms=0.196 pid=893 span.kind=server system=grpc2108gitlab # [ 247.612034] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.634Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"891bf597000fff7ab8d492d1","created_at":"2026-10-04T17:43:36.460Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.462Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-891bf597000fff7ab8d492d1: start","job_status":"start","queue_duration_s":0.172422,"scheduling_latency_s":0.172435}2109gitlab # [ 247.612561] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.648Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"891bf597000fff7ab8d492d1","created_at":"2026-10-04T17:43:36.460Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.462Z","job_size_bytes":19,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-891bf597000fff7ab8d492d1: done: 0.013833 sec","job_status":"done","queue_duration_s":0.172422,"scheduling_latency_s":0.172435,"redis_calls":8,"redis_duration_s":0.001088,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013833,"completed_at":"2026-10-04T17:43:36.648Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 247.652770] gitaly[893]: time="2026-10-04T17:43:36.810Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-04T17:43:36.810" grpc.time_ms=0.447 pid=893 span.kind=server system=grpc2111gitlab # [ 247.653404] gitaly[893]: time="2026-10-04T17:43:36.818Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK diskcache=84119d2c-3e6b-4d67-9bcf-827645b2cf08 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:44:06.756" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.757" pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 247.654060] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.649Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8aac113cff225246c424dc2e","created_at":"2026-10-04T17:43:36.462Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.463Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8aac113cff225246c424dc2e: start","job_status":"start","queue_duration_s":0.185476,"scheduling_latency_s":0.185488}2113gitlab # [ 247.662097] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.661Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8aac113cff225246c424dc2e","created_at":"2026-10-04T17:43:36.462Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.463Z","job_size_bytes":66,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8aac113cff225246c424dc2e: done: 0.012684 sec","job_status":"done","queue_duration_s":0.185476,"scheduling_latency_s":0.185488,"redis_calls":7,"redis_duration_s":0.0008629999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012684,"completed_at":"2026-10-04T17:43:36.661Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab # [ 247.706799] gitaly[893]: time="2026-10-04T17:43:36.818Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7258 command.oublock=0 command.real_time_ms=55 command.spawn_token_fork_ms=0 command.system_time_ms=37 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-04T17:44:06.756" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-04T17:43:36.757" grpc.time_ms=61.58 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses2116gitlab # [ 247.711434] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.662Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d7cd5abf2fe52c8a6b78f9ae","created_at":"2026-10-04T17:43:36.464Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.465Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d7cd5abf2fe52c8a6b78f9ae: start","job_status":"start","queue_duration_s":0.197508,"scheduling_latency_s":0.197521}2117gitlab # [ 247.750829] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d7cd5abf2fe52c8a6b78f9ae","created_at":"2026-10-04T17:43:36.464Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.465Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d7cd5abf2fe52c8a6b78f9ae: done: 0.018636 sec","job_status":"done","queue_duration_s":0.197508,"scheduling_latency_s":0.197521,"redis_calls":7,"redis_duration_s":0.0008619999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018636,"completed_at":"2026-10-04T17:43:36.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2118gitlab # [ 247.800048] gitaly[893]: time="2026-10-04T17:43:36.848Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-04T17:44:06.847" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.847" grpc.time_ms=0.465 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 247.811313] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.682Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d23565d8e122fd6e5b2b997f","created_at":"2026-10-04T17:43:36.469Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.470Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d23565d8e122fd6e5b2b997f: start","job_status":"start","queue_duration_s":0.212349,"scheduling_latency_s":0.212362}2120gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1bac1bdf058413228a5e5ffe12ebe66f522aca65/statuses, in 0.10 seconds)2121(finished: subtest: eval and build post commit statuses, in 8.05 seconds)2122(finished: run the VM test script, in 305.32 seconds)2123gitlab # [ 247.826327] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.698Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d23565d8e122fd6e5b2b997f","created_at":"2026-10-04T17:43:36.469Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.470Z","job_size_bytes":3,"pid":2488,"sidekiq_tid":"m7zg","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d23565d8e122fd6e5b2b997f: done: 0.015541 sec","job_status":"done","queue_duration_s":0.212349,"scheduling_latency_s":0.212362,"redis_calls":7,"redis_duration_s":0.00089,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015541,"completed_at":"2026-10-04T17:43:36.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 247.827511] gitaly[893]: time="2026-10-04T17:43:36.865Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M44076BZQ5CVYWPZQ0QWKHHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-04T17:44:06.864" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-04T17:43:36.865" grpc.time_ms=0.366 pid=893 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125test script finished in 305.35s2126cleanup2127kill QemuMachine (pid 46)2128gitlab # [ 247.869194] sidekiq-cluster[2488]: {"severity":"INFO","time":"2026-10-04T17:43:36.698Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8bb8c94f914019ec67b3434e","created_at":"2026-10-04T17:43:36.470Z","trace_propagation_headers":{"sentry-trace":"cb4714b9157f482685a7bacacd43c193-5843e0528f4241f4","baggage":"sentry-trace_id=cb4714b9157f482685a7bacacd43c193,sentry-release=Unknown"},"correlation_id":"01M44076BZQ5CVYWPZQ0QWKHHK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-04T17:43:36.471Z","job_size_bytes":6,"pidqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2129gitlab # "2130(finished: cleanup, in 1.17 seconds)2131additionally exposed symbols:2132 gitlab,2133 vlan1,2134 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2135[]2136[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-04T17:42:44.790Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2137[]2138[]2139[]2140[]2141[]2142[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-04T17:43:28.826570Z', 'started_at': '2026-10-04T17:43:29.012761Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2143[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2144[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2145[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2146[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2147[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2148[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2149[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2150[{'id': 5, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-10-04T17:43:28.994Z', 'started_at': None, 'finished_at': '2026-10-04T17:43:36.209Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '1bac1bdf058413228a5e5ffe12ebe66f522aca65', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-04T17:43:36.368Z', 'started_at': None, 'finished_at': '2026-10-04T17:43:36.519Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]