vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #469
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.yhoBNRY5zl', fmt=raw size=107374182412(finished: start all VMs, in 52.30 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 8670606a-2801-4071-aebe-f8d2fa0cab4319gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hqpn0xf4zmyc6p0iznfkjc3bsrcm3xap-nixos-system-gitlab-test/init regInfo=/nix/store/lhd5pgv1bzhlclqq6bsj7sya192i3zaz-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 549773079 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000813] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002744] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002755] Using GB pages for direct mapping73gitlab # [ 0.002881] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002889] ACPI: Early table checksum verification disabled75gitlab # [ 0.002892] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002895] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002900] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002906] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002908] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002910] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002912] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002913] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002915] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002916] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002916] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002917] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002917] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002918] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003146] No NUMA configuration found90gitlab # [ 0.003147] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003150] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005517] Zone ranges:93gitlab # [ 0.005518] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005519] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005520] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005521] Device empty97gitlab # [ 0.005522] Movable zone start for each node98gitlab # [ 0.005523] Early memory node ranges99gitlab # [ 0.005523] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005524] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005525] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005526] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005546] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005819] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.118566] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.118993] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.119007] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.119037] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.119040] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.119042] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.119043] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.119044] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.119045] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.119047] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.119048] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.119054] TSC deadline timer available117gitlab # [ 0.119058] CPU topo: Max. logical packages: 1118gitlab # [ 0.119059] CPU topo: Max. logical dies: 1119gitlab # [ 0.119059] CPU topo: Max. dies per package: 1120gitlab # [ 0.119063] CPU topo: Max. threads per core: 1121gitlab # [ 0.119063] CPU topo: Num. cores per package: 4122gitlab # [ 0.119064] CPU topo: Num. threads per package: 4123gitlab # [ 0.119064] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.119087] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.119104] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.119107] kvm-guest: setup PV sched yield127gitlab # [ 0.119123] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.119124] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.119126] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.119127] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.119129] Booting paravirtualized kernel on KVM132gitlab # [ 0.119132] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.123628] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.125922] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.125973] kvm-guest: PV spinlocks enabled136gitlab # [ 0.125975] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.125978] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hqpn0xf4zmyc6p0iznfkjc3bsrcm3xap-nixos-system-gitlab-test/init regInfo=/nix/store/lhd5pgv1bzhlclqq6bsj7sya192i3zaz-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.126073] Unknown kernel command line parameters "regInfo=/nix/store/lhd5pgv1bzhlclqq6bsj7sya192i3zaz-closure-info/registration", will be passed to user space.139gitlab # [ 0.126086] random: crng init done140gitlab # [ 0.126086] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.135296] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.140081] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.140157] software IO TLB: area num 4.144gitlab # [ 0.217475] Fallback order for Node 0: 0145gitlab # [ 0.217483] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.217486] Policy zone: Normal147gitlab # [ 0.220058] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.229774] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.244543] allocated 12582912 bytes of page_ext150gitlab # [ 0.254528] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.254530] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.255415] Dynamic Preempt: lazy153gitlab # [ 0.255612] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.255612] rcu: RCU event tracing is enabled.155gitlab # [ 0.255613] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.255615] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.255615] Rude variant of Tasks RCU enabled.158gitlab # [ 0.255615] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.255616] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.255617] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.255637] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.255639] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.255640] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.260062] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.260383] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.260391] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.260505] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.264075] Console: colour VGA+ 80x25169gitlab # [ 0.264078] printk: legacy console [tty0] enabled170gitlab # [ 0.294994] printk: legacy console [ttyS0] enabled171gitlab # [ 0.405629] ACPI: Core revision 20250807172gitlab # [ 0.406583] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.408215] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.409232] x2apic enabled175gitlab # [ 0.409991] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.410875] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.412053] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.413572] kvm-guest: setup PV IPIs179gitlab # [ 0.415164] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.416235] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.418022] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.420104] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.421155] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.423018] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.424023] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.425019] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.426019] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.427018] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.428018] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.429018] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.431026] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.431811] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.433019] active return thunk: srso_alias_return_thunk194gitlab # [ 0.434039] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.435018] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.436862] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.437856] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.439018] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.440018] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.441018] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.442019] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.443018] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.444018] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.445019] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.446018] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.447018] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.477225] Freeing SMP alternatives memory: 44K208gitlab # [ 0.478022] pid_max: default: 32768 minimum: 301209gitlab # [ 0.478911] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.480118] landlock: Up and running.211gitlab # [ 0.480781] Yama: becoming mindful.212gitlab # [ 0.481229] LSM support for eBPF active213gitlab # [ 0.482251] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.484130] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.486661] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.487643] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.488023] ... version: 2218gitlab # [ 0.488781] ... bit width: 48219gitlab # [ 0.489021] ... generic counters: 6220gitlab # [ 0.489786] ... generic bitmap: 000000000000003f221gitlab # [ 0.490028] ... fixed-purpose counters: 0222gitlab # [ 0.490800] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.491021] ... value mask: 0000ffffffffffff224gitlab # [ 0.491964] ... max period: 00007fffffffffff225gitlab # [ 0.492760] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.493124] signal: max sigframe size: 3376227gitlab # [ 0.493988] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.494670] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.495230] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.500640] smp: Bringing up secondary CPUs ...231gitlab # [ 0.501433] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.502024] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.505153] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.506766] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.507358] Memory: 6011320K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.509021] devtmpfs: initialized237gitlab # [ 0.509889] x86/mm: Memory block size: 128MB238gitlab # [ 0.513162] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.514099] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.515101] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.516305] PM: RTC time: 16:23:07, date: 2026-10-25242gitlab # [ 0.520200] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.522373] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.523076] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.525158] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.526033] audit: initializing netlink subsys (disabled)247gitlab # [ 0.527219] audit: type=2000 audit(1792945386.916:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.527324] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.529021] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.530021] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.531021] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.532021] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.533035] cpuidle: using governor menu254gitlab # [ 0.535240] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.536273] PCI: Using configuration type 1 for base access256gitlab # [ 0.537022] PCI: Using configuration type 1 for extended access257gitlab # [ 0.538211] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.541127] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.543031] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.546028] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.549026] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.555381] ACPI: Added _OSI(Module Device)263gitlab # [ 0.556024] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.556809] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.559703] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.563520] ACPI: Interpreter enabled267gitlab # [ 0.565120] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.567030] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.569119] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.572029] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.575483] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.588484] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.591036] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.594899] acpiphp: Slot [3] registered275gitlab # [ 0.596053] acpiphp: Slot [4] registered276gitlab # [ 0.598079] acpiphp: Slot [5] registered277gitlab # [ 0.599076] acpiphp: Slot [6] registered278gitlab # [ 0.601064] acpiphp: Slot [7] registered279gitlab # [ 0.602079] acpiphp: Slot [8] registered280gitlab # [ 0.603065] acpiphp: Slot [9] registered281gitlab # [ 0.605065] acpiphp: Slot [10] registered282gitlab # [ 0.606075] acpiphp: Slot [11] registered283gitlab # [ 0.608082] acpiphp: Slot [12] registered284gitlab # [ 0.609065] acpiphp: Slot [13] registered285gitlab # [ 0.610064] acpiphp: Slot [14] registered286gitlab # [ 0.612064] acpiphp: Slot [15] registered287gitlab # [ 0.613080] acpiphp: Slot [16] registered288gitlab # [ 0.615065] acpiphp: Slot [17] registered289gitlab # [ 0.616076] acpiphp: Slot [18] registered290gitlab # [ 0.617063] acpiphp: Slot [19] registered291gitlab # [ 0.619051] acpiphp: Slot [20] registered292gitlab # [ 0.619804] acpiphp: Slot [21] registered293gitlab # [ 0.620041] acpiphp: Slot [22] registered294gitlab # [ 0.620781] acpiphp: Slot [23] registered295gitlab # [ 0.622041] acpiphp: Slot [24] registered296gitlab # [ 0.622776] acpiphp: Slot [25] registered297gitlab # [ 0.623040] acpiphp: Slot [26] registered298gitlab # [ 0.623785] acpiphp: Slot [27] registered299gitlab # [ 0.625049] acpiphp: Slot [28] registered300gitlab # [ 0.625796] acpiphp: Slot [29] registered301gitlab # [ 0.626042] acpiphp: Slot [30] registered302gitlab # [ 0.626787] acpiphp: Slot [31] registered303gitlab # [ 0.628036] PCI host bridge to bus 0000:00304gitlab # [ 0.628794] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.629960] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.630925] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.632022] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.633021] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.635034] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.636365] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.638580] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.639468] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.642688] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.644050] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.645021] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.646021] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.647021] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.648213] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.651050] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.654115] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.655290] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.657028] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.658235] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.675086] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.676035] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.677043] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.678200] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.680776] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.685029] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.687028] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.688043] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.700029] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.702588] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.712050] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.714044] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.717083] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.724500] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.735045] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.737044] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.740082] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.746119] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.754064] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.756042] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.758092] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.763725] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.771057] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.773033] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.774044] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.776642] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.782047] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.784028] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.785043] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.787310] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.791053] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.791994] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.794043] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.795027] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.797272] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.800034] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.801049] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.803745] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.807058] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.807973] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.808844] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.812248] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.817029] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.817968] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.818857] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.823644] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.825170] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.826613] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.827159] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.828100] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.831387] iommu: Default domain type: Translated375gitlab # [ 0.832024] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.833355] ACPI: bus type USB registered377gitlab # [ 0.834105] usbcore: registered new interface driver usbfs378gitlab # [ 0.835040] usbcore: registered new interface driver hub379gitlab # [ 0.837036] usbcore: registered new device driver usb380gitlab # [ 0.840169] NetLabel: Initializing381gitlab # [ 0.840849] NetLabel: domain hash size = 128382gitlab # [ 0.841623] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.842099] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.843031] PCI: Using ACPI for IRQ routing385gitlab # [ 0.845222] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.846017] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.846017] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.848024] vgaarb: loaded389gitlab # [ 0.848794] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.850021] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.854281] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.858589] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.859345] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.861028] pnp: PnP ACPI init395gitlab # [ 0.862345] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.871254] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.873043] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.874108] NET: Registered PF_INET protocol family399gitlab # [ 0.876460] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.895364] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.896984] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.898497] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.902294] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.903715] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.904982] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.906359] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.907905] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.909371] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.910396] NET: Registered PF_XDP protocol family410gitlab # [ 0.911280] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.912328] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.913388] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.914581] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.915823] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.917212] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.918236] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.921124] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.923909] PCI: CLS 0 bytes, default 64419gitlab # [ 0.924738] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.925228] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.925868] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.925989] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.949183] Initialise system trusted keyrings424gitlab # [ 0.950391] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.961852] Key type asymmetric registered426gitlab # [ 0.962603] Asymmetric key parser 'x509' registered427gitlab # [ 0.963593] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.965112] io scheduler mq-deadline registered429gitlab # [ 0.965947] io scheduler kyber registered430gitlab # [ 0.970250] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.971597] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.974014] Linux agpgart interface v0.103433gitlab # [ 0.974829] ACPI: bus type drm_connector registered434gitlab # [ 0.977263] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.978395] usbserial: USB Serial support registered for generic436gitlab # [ 0.979439] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.979439] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.981810] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.983245] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.984474] NET: Registered PF_INET6 protocol family441gitlab # [ 0.986248] Segment Routing with IPv6442gitlab # [ 0.986972] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.989166] IPI shorthand broadcast: enabled444gitlab # [ 0.993595] sched_clock: Marking stable (843010835, 149626589)->(1016459318, -23821894)445gitlab # [ 0.995403] registered taskstats version 1446gitlab # [ 0.996456] Loading compiled-in X.509 certificates447gitlab # [ 1.006305] Demotion targets for Node 0: null448gitlab # [ 1.007518] Key type .fscrypt registered449gitlab # [ 1.008234] Key type fscrypt-provisioning registered450gitlab # [ 1.009212] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.010161] ima: Allocated hash algorithm: sha1452gitlab # [ 1.010989] ima: No architecture policies found453gitlab # [ 1.012046] PM: Magic number: 14:424:389454gitlab # [ 1.013758] RAS: Correctable Errors collector initialized.455gitlab # [ 1.018242] clk: Disabling unused clocks456gitlab # [ 1.018971] PM: genpd: Disabling unused power domains457gitlab # [ 1.208166] Freeing initrd memory: 29392K458gitlab # [ 1.214332] Freeing unused decrypted memory: 2028K459gitlab # [ 1.220762] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.223429] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.228266] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.232122] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.300281] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.301460] Run /init as init process465gitlab # [ 1.312830] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.334069] fuse: init (API version 7.45)467gitlab # [ 1.342229] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.349099] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.352195] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.391036] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.727602] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.768469] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.770718] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.772868] systemd[1]: Running in initrd.475gitlab # [ 1.775265] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.778187] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.900460] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.955971] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.967429] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.968669] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.970125] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.971311] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.972469] systemd[1]: Reached target Path Units.484gitlab # [ 1.973362] systemd[1]: Reached target Slice Units.485gitlab # [ 1.974282] systemd[1]: Reached target Swaps.486gitlab # [ 1.975111] systemd[1]: Reached target Timer Units.487gitlab # [ 1.976138] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.977383] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.978554] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.979592] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.980682] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.981682] systemd[1]: Reached target Socket Units.493gitlab # [ 1.983572] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.985676] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.987562] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.004825] systemd[1]: Starting Journal Service...497gitlab # [ 2.011725] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.014203] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.043007] netfs: FS-Cache loaded500gitlab # [ 2.045811] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.051217] 9pnet: Installing 9P2000 support502gitlab # [ 2.052507] systemd-journald[91]: Collecting audit messages is disabled.503gitlab # [ 2.053242] systemd[1]: Finished Create List of Static Device Nodes.504gitlab # [ 2.057501] systemd[1]: modprobe@configfs.service: Deactivated successfully.505gitlab # [ 2.064749] systemd[1]: Finished Load Kernel Module configfs.506gitlab # [ 2.066131] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.507gitlab # [ 2.067877] systemd[1]: Finished Load Kernel Module 9pnet_virtio.508gitlab # [ 2.069573] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config509gitlab # [ 2.073134] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...510gitlab # [ 2.075120] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.511gitlab # [ 2.078312] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev512gitlab # [ 2.084014] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.087725] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.090552] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.515gitlab # [ 1.944402] systemd-modules-load[92]: Using 4 probe threads516gitlab # [ 1.945821] systemd-modules-load[92]: Inserted module 'virtio_gpu'517gitlab # [ 1.946827] systemd-modules-load[92]: Inserted module 'virtio[ 2.096710] systemd[1]: Starting Create Static Device Nodes in /dev...518gitlab # _balloon'519gitlab # [ 1.948609] s[ 2.098149] systemd[1]: Started Journal Service.520gitlab # ystemd-modules-load[92]: Inserted module 'dm_mod'521gitlab # [ 1.950432] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.955430] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.956551] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.957535] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.958416] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.959407] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.966879] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.978302] systemd-udevd[111]: Using default interface naming scheme 'v261'.529gitlab # [ 1.988513] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.018895] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.019966] systemd[1]: Reached target System Initialization.532gitlab # [ 2.020764] systemd[1]: Reached target Basic System.533gitlab # [ 2.248126] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.248933] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.250063] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.251883] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.252961] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.254155] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.255254] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.255959] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd541gitlab # [ 2.256767] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.259520] virtio_blk virtio4: 4/0/0 default/read/poll queues543gitlab # [ 2.262418] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)544gitlab # [ 2.266797] SCSI subsystem initialized545gitlab # [ 2.268131] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12546gitlab # [ 2.269872] hub 1-0:1.0: USB hub found547gitlab # [ 2.270582] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.271284] serio: i8042 KBD port at 0x60,0x64 irq 1549gitlab # [ 2.272097] serio: i8042 AUX port at 0x60,0x64 irq 12550gitlab # [ 2.272154] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.277807] virtio_blk virtio5: [vdb] 11953168 512-byte logical blocks (6.12 GB/5.70 GiB)552gitlab # [ 2.165313] systemd[1]: Starting Virtual Console Setup...553gitlab # [ 2.166428] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line.554gitlab # [ 2.168067] (udev-worker)[132]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.555gitlab # [ 2.170457] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.323337] scsi host0: ata_piix557gitlab # [ 2.324509] scsi host1: ata_piix558gitlab # [ 2.325153] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # [ 2.326327] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0560gitlab # [ 2.328614] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0561gitlab # [ 2.186898] systemd[1]: Found device /dev/disk/by-label/nix-store.562gitlab # [ 2.187966] systemd-vconsole-setup[147]: Configuration of first virtual console was skipped, ignoring remaining ones.563gitlab # [ 2.191736] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.193111] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 2.194030] systemd[1]: Reached target Initrd Root Device.566gitlab # [ 2.194825] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...567gitlab # [ 2.214671] systemd-fsck[160]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.217443] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.483278] ata2: found unknown device (class 0)570gitlab # [ 2.486191] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.490369] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.493445] usb 1-1: new full-speed USB device number 2 using uhci_hcd573gitlab # [ 2.551028] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.578322] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.661659] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.662910] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.663970] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.664613] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.665190] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.695188] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.708788] usbcore: registered new interface driver usbhid582gitlab # [ 2.710939] usbhid: USB HID core driver583gitlab # [ 2.719814] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.723896] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.902130] systemd[1]: Mounting /sysroot...586gitlab # [ 3.194406] EXT4-fs (vda): mounted filesystem 8670606a-2801-4071-aebe-f8d2fa0cab43 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.050766] systemd[1]: Mounted /sysroot.588gitlab # [ 3.051714] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.053229] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.055231] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.057316] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.059300] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.069466] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.077200] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.229377] 9p: Installing v9fs 9p2000 file system support596gitlab # [ 3.087643] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.090261] systemd[1]: Mount[ 3.240267] erofs (device vdb): mounted with root inode @ nid 128.598gitlab # ed /sysroot/run.599gitlab # [ 3.092657] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 3.094491] systemd[1]: Mounted /sysroot/tmp/xchg.601gitlab # [ 3.096312] systemd[1]: Mounted /sysroot/nix/.ro-store.602gitlab # [ 3.098490] systemd[1]: Starting rw-sysroot-nix-store.service...603gitlab # [ 3.100599] systemd-sysroot-fstab-check[182]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.103987] systemd[1]: Reload requested from client PID 182 ('systemd-sysroot') (unit initrd-parse-etc.service)...605gitlab # [ 3.105541] systemd[1]: Reloading...606gitlab # [ 3.157710] systemd[1]: Reloading finished in 55 ms.607gitlab # [ 3.179118] systemd-sysroot-fstab-check[182]: Requesting initrd-fs.target/start/replace...608gitlab # [ 3.180535] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.181791] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.182793] systemd-sysroot-fstab-check[182]: Requesting swap.target/start/replace...611gitlab # [ 3.184063] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.185314] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.186538] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.187618] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.209645] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.210794] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.902284] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.928955] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.929970] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.931079] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.932741] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.966319] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.967533] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.971246] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.972088] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.972908] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.002329] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.004201] systemd[1]: Stopped target Basic System.629gitlab # [ 4.005763] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.007431] systemd[1]: Stopped target Path Units.631gitlab # [ 4.008971] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.011258] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.013956] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.015557] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.017216] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.019129] systemd[1]: Stopped target Swaps.637gitlab # [ 4.020589] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.022397] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.024209] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.026128] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.028436] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.029964] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.033303] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.035159] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.037624] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.039174] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.041304] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.042822] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.044921] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.047218] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.049232] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.051365] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.052899] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.054722] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.056680] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.058247] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.059809] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.060991] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.062091] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.063511] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.064611] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.065740] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.066636] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.067618] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.068724] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.069872] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.070659] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.071524] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.072621] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.073603] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.074828] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.075917] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.076852] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.080341] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.081842] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.082542] systemd[1]: Reached target Switch Root.677gitlab # [ 4.083285] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.153691] initrd-nixos-activation-start[227]: booting system configuration /nix/store/hqpn0xf4zmyc6p0iznfkjc3bsrcm3xap-nixos-system-gitlab-test679gitlab # [ 4.182377] initrd-nixos-activation-start[227]: running activation script...680gitlab # [ 4.373181] initrd-nixos-activation-start[250]: setting up /etc...681gitlab # [ 4.458310] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.459623] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.461738] systemd[1]: Starting Switch Root...684gitlab # [ 4.491407] systemd[1]: Switching root.685gitlab # [ 4.705356] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.829687] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.189021] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.199395] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.201303] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.203322] systemd[1]: Detected first boot.691gitlab # [ 5.205936] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.345245] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.405533] systemd[1]: Applying preset policy.694gitlab # [ 5.550543] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.667876] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.669299] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.671506] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.673727] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.675147] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.676574] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.677595] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.678872] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.679972] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.680828] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.681652] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.682486] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.683238] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.684058] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.684987] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.685938] systemd[1]: Reached target Path Units.711gitlab # [ 5.686698] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.687534] systemd[1]: Reached target Slice Units.713gitlab # [ 5.688256] systemd[1]: Reached target Swaps.714gitlab # [ 5.689730] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.691689] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.693066] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.694660] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.695595] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.697962] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.699555] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.701411] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.702577] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.703793] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.705197] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.708066] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.709205] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.710193] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.713008] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.714937] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.716937] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.725200] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.729945] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.733954] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.741698] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.742655] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.744235] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.745918] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.760134] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.761092] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.765104] systemd[1]: Starting Journal Service...741gitlab # [ 5.771417] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.776082] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.779106] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.781390] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.783289] systemd-journald[320]: Collecting audit messages is enabled.746gitlab # [ 5.786774] systemd[1]: Starting Coldplug All udev Devices...747gitlab # [ 5.795594] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 5.796756] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 5.797839] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 5.798892] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 5.799915] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 5.652756] systemd[1]: Queued start job for [ 5.802857] EXT4-fs (vda): re-mounted 8670606a-2801-4071-aebe-f8d2fa0cab43.753gitlab # default target Multi-User System.754gitlab # [ 5.804963] systemd[1]: Finished Create List of Static Device Nodes.755gitlab # [ 5.655627] systemd[1]: Unnecessary job was removed for /dev/[ 5.806860] systemd[1]: Started Journal Service.756gitlab # vdb.757gitlab # [ 5.658927] systemd[1]: systemd-journald.service: Deactivated successfully.758gitlab # [ 5.662520] systemd-modules-load[322]: Using 3 probe threads759gitlab # [ 5.664201] systemd[1]: modprobe@configfs.service: Deactivated successfully.760gitlab # [ 5.666375] systemd[1]: Finished Load Kernel Module configfs.761gitlab # [ 5.668082] systemd[1]: Mounted FUSE Control File System.762gitlab # [ 5.669611] systemd[1]: Finished Remount Root and Kernel File Systems.763gitlab # [ 5.820993] loop: module loaded764gitlab # [ 5.672321] systemd[1]: Listening on Disk Image Download Service Socket.765gitlab # [ 5.673383] systemd[1]: Mounting Kernel Configuration File System...766gitlab # [ 5.674363] systemd[1]: Starting Flush Journal to Persistent Storage...767gitlab # [ 5.675441] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 5.677266] systemd-oomd[323]: No swap; memory pressure usage will be degraded769gitlab # [ 5.678531] systemd-modules-load[322]: Inserted module 'loop'770gitlab # [ 5.679438] systemd[1]: Starting Load/Save OS Random Seed...771gitlab # [ 5.680307] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...772gitlab # [ 5.681514] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 5.685213] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.774gitlab # [ 5.686553] systemd[1]: Mounted Kernel Configuration File System.775gitlab # [ 5.687645] systemd-modules-load[322]: Inserted module 'tls'776gitlab # [ 5.689960] systemd[1]: Finished Load Kernel Modules.777gitlab # [ 5.690789] systemd[1]: Starting Firewall...778gitlab # [ 5.691659] systemd[1]: Starting Apply Kernel Variables...779gitlab # [ 5.845762] systemd-journald[320]: Received client request to flush runtime journal.780gitlab # [ 5.744198] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.746933] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.782gitlab # [ 5.748638] systemd[1]: Reached target First Boot Complete.783gitlab # [ 5.749841] systemd[1]: Starting Create Static Device Nodes in /dev...784gitlab # [ 5.750702] systemd[1]: Finished Apply Kernel Variables.785gitlab # [ 5.751446] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 5.752304] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 5.753262] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 5.754360] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 5.759671] systemd-udevd[353]: Using default interface naming scheme 'v261'.790gitlab # [ 5.784721] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 5.791934] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 5.849075] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 5.864402] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 5.909558] (udev-worker)[429]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.928616] (udev-worker)[412]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 5.930767] (udev-worker)[412]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 5.939066] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.798gitlab # [ 5.940433] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 5.941674] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 5.943226] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 5.945634] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 5.947289] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 5.949129] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.104675] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input3805gitlab # [ 6.108668] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4806gitlab # [ 6.113104] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6807gitlab # [ 6.114524] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5808gitlab # [ 6.115164] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console809gitlab # [ 6.124847] ACPI: button: Power Button [PWRF]810gitlab # [ 6.131385] Console: switching to colour dummy device 80x25811gitlab # [ 6.132706] [drm] Found bochs VGA, ID 0xb0c5.812gitlab # [ 6.133131] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.813gitlab # [ 6.134686] rtc_cmos 00:05: RTC can wake from S4814gitlab # [ 6.136202] Floppy drive(s): fd0 is 2.88M AMI BIOS815gitlab # [ 6.137134] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic816gitlab # [ 6.137869] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0817gitlab # [ 5.993036] systemd[1]: Finished Firewall.818gitlab # [ 6.141342] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0819gitlab # [ 6.146899] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD820gitlab # [ 6.148957] Console: switching to colour frame buffer device 160x50821gitlab # [ 6.150389] FDC 0 is a S82078B822gitlab # [ 6.151691] rtc_cmos 00:05: registered as rtc0823gitlab # [ 6.152333] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device824gitlab # [ 6.153119] rtc_cmos 00:05: setting system clock to 2026-10-25T16:23:12 UTC (1792945392)825gitlab # [ 6.155376] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 6.160090] systemd-journald[320]: Time jumped backwards, rotating.827gitlab # [ 6.172281] parport_pc 00:03: reported by Plug and Play ACPI828gitlab # [ 6.173193] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]829gitlab # [ 6.186533] mousedev: PS/2 mouse device common for all mice830gitlab # [ 6.078191] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.089576] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.094703] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.100304] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.297162] ppdev: user-space parallel port driver835gitlab # [ 6.184032] systemd-vconsole-setup[492]: Configuration of first virtual console was skipped, ignoring remaining ones.836gitlab # [ 6.187211] systemd[1]: Finished Virtual Console Setup.837gitlab # [ 6.351583] kvm_amd: TSC scaling supported838gitlab # [ 6.352148] kvm_amd: Nested Virtualization enabled839gitlab # [ 6.352789] kvm_amd: Nested Paging enabled840gitlab # [ 6.353237] kvm_amd: LBR virtualization supported841gitlab # [ 6.353881] kvm_amd: Virtual VMLOAD VMSAVE supported842gitlab # [ 6.354447] kvm_amd: Virtual GIF supported843gitlab # [ 6.354976] kvm_amd: Virtual NMI enabled844gitlab # [ 6.389013] EDAC MC: Ver: 3.0.0845gitlab # [ 6.522989] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.544892] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.546789] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.548895] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.551403] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.553555] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.555656] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.558715] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.570906] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.598504] systemd[1]: Finished Create System Files and Directories.855gitlab # [ 6.606224] systemd[1]: Starting Rebuild Journal Catalog...856gitlab # [ 6.610974] systemd[1]: Starting Record System Boot/Shutdown in UTMP...857gitlab # [ 6.619906] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.623239] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.634083] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.649867] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.651561] systemd[1]: Starting Update is Completed...862gitlab # [ 6.666925] systemd[1]: Finished Update is Completed.863gitlab # [ 6.727627] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.729794] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 6.953600] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 6.955708] systemd[1]: Reached target System Initialization.867gitlab # [ 6.957635] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 6.960067] systemd[1]: Started logrotate.timer.869gitlab # [ 6.961661] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 6.963777] systemd[1]: Reached target Timer Units.871gitlab # [ 6.965427] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 6.967512] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 6.969318] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 6.971277] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 6.974068] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 6.976137] systemd[1]: Reached target Socket Units.877gitlab # [ 6.978208] systemd[1]: Starting D-Bus System Message Bus...878gitlab # [ 7.004404] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.007478] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.009875] dbus-broker-launch[574]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.014885] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.031405] dbus-broker-launch[574]: Ready883gitlab # [ 7.034308] systemd[1]: Reached target Basic System.884gitlab # [ 7.037087] systemd[1]: Started backdoor.service.885gitlab # [ 7.040156] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.043663] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.054189] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.058072] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.061418] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 7.066306] systemd[1]: Started Reset console on configuration changes.891gitlab # [ 7.069526] systemd[1]: Starting resolvconf update...892gitlab # [ 7.079907] logrotate[579]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.893gitlab # [ 7.083772] logrotate[579]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf894gitlab # [ 7.087256] logrotate[579]: note: 'monthly' overrides previously specified 'weekly'895gitlab # [ 7.090203] logrotate[579]: Reading state from file: /var/lib/logrotate.status896gitlab # [ 7.092676] logrotate[579]: state file /var/lib/logrotate.status does not exist897gitlab # [ 7.095739] logrotate[579]: Allocating hash table for state file, size 64 entries898gitlab # [ 7.095879] logrotate[579]: Handling 4 logs899gitlab # [ 7.096778] logrotate[579]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed900gitlab # [ 7.097661] logrotate[579]: considering log /var/log/btmp901gitlab # [ 7.098650] logrotate[579]: Creating new state902gitlab # [ 7.098818] logrotate[579]: Now: 2026-10-25 16:23903gitlab # [ 7.099440] logrotate[579]: Last rotated at 2026-10-25 16:00904gitlab # [ 7.099916] logrotate[579]: log does not need rotating (log has already been rotated)905gitlab # [ 7.100510] logrotate[579]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 7.101326] logrotate[579]: considering log /var/log/wtmp907gitlab # [ 7.101835] logrotate[579]: Creating new state908gitlab # [ 7.102522] logrotate[579]: Now: 2026-10-25 16:23909gitlab # [ 7.103051] logrotate[579]: Last rotated at 2026-10-25 16:00910gitlab # [ 7.103609] logrotate[579]: log does not need rotating (log has already been rotated)911gitlab # [ 7.104128] logrotate[579]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed912gitlab # [ 7.104664] logrotate[579]: switching euid from 0 to 165 and egid from 0 to 165 (pid 579)913gitlab # [ 7.105226] logrotate[579]: considering log /var/gitlab/state/log/*.log914gitlab # [ 7.105792] logrotate[579]: log /var/gitlab/state/log/*.log does not exist -- skipping915gitlab # [ 7.106676] logrotate[579]: Creating new state916gitlab # [ 7.107112] logrotate[579]: switching euid from 165 to 0 and egid from 165 to 0 (pid 579)917gitlab # [ 7.107643] logrotate[579]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed918gitlab # [ 7.108196] logrotate[579]: switching euid from 0 to 60 and egid from 0 to 60 (pid 579)919gitlab # [ 7.108681] logrotate[579]: considering log /var/log/nginx/*.log920gitlab # [ 7.109394] logrotate[579]: log /var/log/nginx/*.log does not exist -- skipping921gitlab # [ 7.109947] logrotate[579]: Creating new state922gitlab # [ 7.110660] logrotate[579]: not running postrotate script, since no logs were rotated923gitlab # [ 7.111413] logrotate[579]: switching euid from 60 to 0 and egid from 60 to 0 (pid 579)924gitlab # [ 7.112273] nsncd[580]: Oct 25 16:23:13.598 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"925gitlab # [ 7.112984] systemd[1]: Finished Logrotate configuration check.926gitlab # [ 7.113828] systemd[1]: Finished Import lastlog data into lastlog2 database.927gitlab # [ 7.114566] systemd[1]: Finished Post-Boot Actions.928gitlab # [ 7.115298] systemd[1]: Started Name Service Cache Daemon (nsncd).929gitlab # [ 7.115952] systemd[1]: Reached target Host and Network Name Lookups.930gitlab # [ 7.116750] systemd[1]: Reached target User and Group Name Lookups.931gitlab # [ 7.117860] systemd[1]: Starting User Login Management...932gitlab # connecting to host...933gitlab: Guest shell says: b'Spawning backdoor root shell...\n'934gitlab: connected to guest root shell935gitlab: (connecting took 7.78 seconds)936gitlab: (finished: waiting for the VM to finish booting, in 7.78 seconds)937gitlab # [ 7.164429] systemd-logind[605]: New seat seat0.938gitlab # [ 7.167434] systemd-logind[605]: Watching system buttons on /dev/input/event3 (Power Button)939gitlab # [ 7.168855] systemd-logind[605]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard)940gitlab # [ 7.169461] systemd-logind[605]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)941gitlab # [ 7.172140] systemd[1]: Started User Login Management.942gitlab # [ 7.173364] systemd[1]: Starting linger-users.service...943gitlab # [ 7.183506] systemd[1]: Stopped target Host and Network Name Lookups.944gitlab # [ 7.183679] systemd[1]: Stopping Host and Network Name Lookups...945gitlab # [ 7.186072] systemd[1]: Stopped target User and Group Name Lookups.946gitlab # [ 7.186373] systemd[1]: Stopping User and Group Name Lookups...947gitlab # [ 7.186850] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...948gitlab # [ 7.189547] systemd[1]: nscd.service: Deactivated successfully.949gitlab # [ 7.190561] systemd[1]: Stopped Name Service Cache Daemon (nsncd).950gitlab # [ 7.191590] systemd[1]: nscd.service: Consumed 23ms CPU time over 132ms wall clock time, 7.7M memory peak, 5.5M read from disk.951gitlab # [ 7.193384] systemd[1]: linger-users.service: Deactivated successfully.952gitlab # [ 7.194504] systemd[1]: Finished linger-users.service.953gitlab # [ 7.196536] systemd[1]: Starting Name Service Cache Daemon (nsncd)...954gitlab # [ 7.210995] systemd[1]: Finished resolvconf update.955gitlab # [ 7.212438] systemd[1]: Reached target Preparation for Network.956gitlab # [ 7.213640] nsncd[676]: Oct 25 16:23:13.709 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"957gitlab # [ 7.215945] systemd[1]: Starting DHCP Client...958gitlab # [ 7.216738] systemd[1]: Starting Address configuration of eth1...959gitlab # [ 7.219391] systemd[1]: Starting Extra networking commands....960gitlab # [ 7.221701] systemd[1]: Started Name Service Cache Daemon (nsncd).961gitlab # [ 7.221847] systemd[1]: Reached target Host and Network Name Lookups.962gitlab # [ 7.222560] systemd[1]: Reached target User and Group Name Lookups.963gitlab # [ 7.245665] network-addresses-eth1-start[697]: adding address 192.168.1.1/24... done964gitlab # [ 7.249088] network-addresses-eth1-start[697]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.256741] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.279844] systemd[1]: Finished Extra networking commands..967gitlab # [ 7.280699] systemd[1]: Reached target Network.968gitlab # [ 7.282061] systemd[1]: Starting gitlab-workhorse.service...969gitlab # [ 7.285428] systemd[1]: Starting Nginx Web Server...970gitlab # [ 7.285941] dhcpcd[705]: dhcpcd-10.3.2 starting971gitlab # [ 7.287554] dhcpcd[764]: dev: loaded udev972gitlab # [ 7.288830] systemd[1]: Starting PostgreSQL Server...973gitlab # [ 7.292375] systemd[1]: Starting Redis Server - redis-gitlab...974gitlab # [ 7.443146] 8021q: 802.1Q VLAN Support v1.8975gitlab # [ 7.443839] 8021q: adding VLAN 0 to HW filter on device eth1976gitlab # [ 7.295897] systemd[1]: Starting Permit User Sessions...977gitlab # [ 7.305885] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.978gitlab # [ 7.308972] systemd[1]: Finished Permit User Sessions.979gitlab # [ 7.313504] systemd[1]: Started Getty on tty1.980gitlab # [ 7.314547] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.390853] nginx-pre-start[786]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok982gitlab # [ 7.391366] nginx-pre-start[786]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful983gitlab # [ 7.543950] cfg80211: Loading compiled-in X.509 certificates for regulatory database984gitlab # [ 7.397066] systemd[1]: Started Nginx Web Server.985gitlab # [ 7.553099] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.554093] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.556363] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.558590] cfg80211: failed to load regulatory.db989gitlab # [ 7.427510] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres".990gitlab # [ 7.427870] postgresql-pre-start[789]: This user must also own the server process.991gitlab # [ 7.433759] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8".992gitlab # [ 7.434101] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8".993gitlab # [ 7.434567] postgresql-pre-start[789]: The default text search configuration will be set to "english".994gitlab # [ 7.435110] postgresql-pre-start[789]: Data page checksums are enabled.995gitlab # [ 7.435593] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok996gitlab # [ 7.438784] redis-server[785]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.997gitlab # [ 7.441945] redis-server[785]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo998gitlab # [ 7.442440] postgresql-pre-start[789]: creating subdirectories ... ok999gitlab # [ 7.442833] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix1000gitlab # [ 7.443519] systemd[1]: Started Redis Server - redis-gitlab.1001gitlab # [ 7.445266] redis-server[785]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=785, just started1002gitlab # [ 7.445499] redis-server[785]: Configuration loaded1003gitlab # [ 7.446062] redis[785]: monotonic clock: POSIX clock_gettime1004gitlab # [ 7.446541] redis[785]: Running mode=standalone, port=0.1005gitlab # [ 7.449310] redis[785]: Server initialized1006gitlab # [ 7.449632] redis[785]: Ready to accept connections unix1007gitlab # [ 7.450161] redis[785]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1008gitlab # [ 7.603377] 8021q: adding VLAN 0 to HW filter on device eth01009gitlab # [ 7.455060] dhcpcd[764]: eth0: waiting for carrier1010gitlab # [ 7.455807] dhcpcd[764]: eth0: carrier acquired1011gitlab # [ 7.460140] dhcpcd[764]: DUID 00:01:00:01:32:70:e9:71:52:54:00:12:34:561012gitlab # [ 7.460442] dhcpcd[764]: eth0: IAID 00:12:34:561013gitlab # [ 7.460941] dhcpcd[764]: eth0: adding address fe80::5054:ff:fe12:34561014gitlab # [ 7.479155] postgresql-pre-start[789]: selecting default "max_connections" ... 1001015gitlab # [ 7.515322] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 7.707600] dhcpcd[764]: eth0: soliciting a DHCP lease1017gitlab # [ 7.865165] NET: Registered PF_PACKET protocol family1018gitlab # [ 7.724534] dhcpcd[764]: eth0: offered 10.0.2.15 from 10.0.2.21019gitlab # [ 7.728201] dhcpcd[764]: eth0: probing address 10.0.2.15/241020gitlab # [ 7.836366] systemd[1]: Started gitlab-workhorse.service.1021gitlab # [ 7.909059] postgresql-pre-start[789]: selecting default time zone ... UTC1022gitlab # [ 7.911876] postgresql-pre-start[789]: creating configuration files ... ok1023gitlab # [ 8.050658] gitlab-workhorse[822]: time="2026-10-25T16:23:14Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41024gitlab # [ 8.051042] gitlab-workhorse[822]: time="2026-10-25T16:23:14Z" level=info msg="Using redis/go-redis"1025gitlab # [ 8.051504] gitlab-workhorse[822]: time="2026-10-25T16:23:14Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1026gitlab # [ 8.053495] postgresql-pre-start[789]: running bootstrap script ... ok1027gitlab # [ 8.469288] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok1028gitlab # [ 8.689599] postgresql-pre-start[789]: syncing data to disk ... ok1029gitlab # [ 8.690406] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections1030gitlab # [ 8.692377] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1031gitlab # [ 8.693219] postgresql-pre-start[789]: Success. You can now start the database server using:1032gitlab # [ 8.694463] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1033gitlab # [ 8.803299] postgres[848]: [848] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1034gitlab # [ 8.807894] postgres[848]: [848] LOG: listening on IPv6 address "::1", port 54321035gitlab # [ 8.810427] postgres[848]: [848] LOG: listening on IPv4 address "127.0.0.1", port 54321036gitlab # [ 8.821347] postgres[848]: [848] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1037gitlab # [ 8.840220] postgres[857]: [857] LOG: database system was shut down at 2026-10-25 16:23:14 GMT1038gitlab # [ 8.851778] postgres[848]: [848] LOG: database system is ready to accept connections1039gitlab # [ 8.860121] systemd[1]: Started PostgreSQL Server.1040gitlab # [ 8.861838] systemd[1]: Starting PostgreSQL Setup Scripts...1041gitlab # [ 9.140934] postgresql-setup-start[868]: CREATE DATABASE1042gitlab # [ 9.151494] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[873]: mkdir -p /var/gitlab/state/home/.ssh: OK1043gitlab # [ 9.156599] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[873]: chmod 700 /var/gitlab/state/home/.ssh: OK1044gitlab # [ 9.177296] postgresql-setup-start[882]: CREATE ROLE1045gitlab # [ 9.188888] postgresql-setup-start[888]: ALTER DATABASE1046gitlab # [ 9.201541] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 9.204576] systemd[1]: Started gitaly.service.1048gitlab # [ 9.210467] postgresql-setup-start[897]: CREATE ROLE1049gitlab # [ 9.214588] systemd[1]: Finished PostgreSQL Setup Scripts.1050gitlab # [ 9.216211] systemd[1]: Reached target PostgreSQL.1051gitlab # [ 9.217639] systemd[1]: Starting gitlab-db-config.service...1052gitlab # [ 9.219231] systemd[1]: Starting gitlab-postgresql.service...1053gitlab # [ 9.309883] gitlab-postgresql-start[911]: CREATE DATABASE1054gitlab # [ 9.340917] gitlab-postgresql-start[923]: CREATE EXTENSION1055gitlab # [ 9.412833] gitlab-postgresql-start[925]: CREATE EXTENSION1056gitlab # [ 9.414733] systemd[1]: Finished gitlab-postgresql.service.1057gitlab # [ 9.673566] gitaly[899]: time="2026-10-25T16:23:16.169Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8991058gitlab # [ 9.681499] gitaly[899]: time="2026-10-25T16:23:16.169Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8991059gitlab # [ 9.685322] gitaly[899]: time="2026-10-25T16:23:16.169Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8991060gitlab # [ 9.689991] gitaly[899]: time="2026-10-25T16:23:16.169Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8991061gitlab # [ 9.693985] gitaly[899]: time="2026-10-25T16:23:16.169Z" level=info msg="Starting Gitaly" pid=899 version=1062gitlab # [ 9.745396] dhcpcd[764]: eth0: soliciting an IPv6 router1063gitlab # [ 9.748133] dhcpcd[764]: eth0: Router Advertisement from fe80::21064gitlab # [ 9.749046] dhcpcd[764]: eth0: adding address fec0::5054:ff:fe12:3456/641065gitlab # [ 9.749976] dhcpcd[764]: eth0: adding route to fec0::/641066gitlab # [ 9.750840] dhcpcd[764]: eth0: adding default route via fe80::21067gitlab # [ 9.846508] gitaly[899]: time="2026-10-25T16:23:16.342Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=172 pid=8991068gitlab # [ 9.848353] gitaly[899]: time="2026-10-25T16:23:16.342Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8991069gitlab # [ 9.849958] gitaly[899]: time="2026-10-25T16:23:16.343Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8991070gitlab # [ 9.851454] gitaly[899]: time="2026-10-25T16:23:16.343Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-899/git-exec-1709042169.d/git pid=8991071gitlab # [ 9.853399] gitaly[899]: time="2026-10-25T16:23:16.347Z" level=info msg="finished detecting git version" duration_ms=4 pid=8991072gitlab # [ 9.855120] gitaly[899]: time="2026-10-25T16:23:16.347Z" level=info msg="using Git version" pid=899 version=2.53.g1073gitlab # [ 9.856578] gitaly[899]: time="2026-10-25T16:23:16.348Z" level=info msg="clearing disk cache object folder" pid=899 storage=default1074gitlab # [ 9.858305] gitaly[899]: time="2026-10-25T16:23:16.348Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache557120072 pid=899 storage=default1075gitlab # [ 9.860878] gitaly[899]: time="2026-10-25T16:23:16.348Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache557120072 pid=899 storage=default1076gitlab # [ 9.863763] gitaly[899]: time="2026-10-25T16:23:16.348Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8991077gitlab # [ 9.866403] gitaly[899]: time="2026-10-25T16:23:16.348Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8991078gitlab # [ 9.869043] gitaly[899]: time="2026-10-25T16:23:16.348Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache557120072 clear_duration_ms=0 pid=899 storage=default1079gitlab # [ 9.885610] gitaly[899]: time="2026-10-25T16:23:16.382Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8991080gitlab # [ 9.887941] gitaly[899]: time="2026-10-25T16:23:16.382Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=899 schema=unix1081gitlab # [ 9.890247] gitaly[899]: time="2026-10-25T16:23:16.382Z" level=info msg="listening at address" address=/run/gitaly/gitaly-899/sock.d/intern pid=899 schema=unix1082gitlab # [ 9.890866] gitaly[899]: time="2026-10-25T16:23:16.382Z" level=info msg="finished tempdir cleaner walk" pid=899 storage=default time_ms=01083gitlab # [ 9.891479] gitaly[899]: time="2026-10-25T16:23:16.384Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8991084gitlab # [ 9.892033] gitaly[899]: time="2026-10-25T16:23:16.384Z" level=info msg="Started Gitaly" duration_ms=214 pid=8991085gitlab # [ 9.892575] gitaly[899]: time="2026-10-25T16:23:16.384Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8991086gitlab # [ 9.893115] gitaly[899]: time="2026-10-25T16:23:16.382Z" level=info msg="counting repositories" pid=8991087gitlab # [ 9.893668] gitaly[899]: time="2026-10-25T16:23:16.385Z" level=info msg="starting to count repositories" pid=899 storage_path=/var/gitlab/state/repositories1088gitlab # [ 9.894850] gitaly[899]: time="2026-10-25T16:23:16.384Z" level=info msg="maintenance: daily scheduled" pid=899 scheduled="2026-10-26 12:00:00 +0000 UTC"1089gitlab # [ 9.895763] gitaly[899]: time="2026-10-25T16:23:16.385Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=899 storage_path=/var/gitlab/state/repositories1090gitlab # [ 9.896477] gitaly[899]: time="2026-10-25T16:23:16.385Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8991091gitlab # [ 10.701934] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 10.702932] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 10.738583] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 11.867275] gitaly[899]: time="2026-10-25T16:23:18.363Z" level=info msg="License database preloaded" duration_ms=2193 pid=8991095gitlab # [ 12.862627] dhcpcd[764]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 12.863479] dhcpcd[764]: eth0: adding route to 10.0.2.0/241097gitlab # [ 12.864863] dhcpcd[764]: eth0: adding default route via 10.0.2.21098gitlab # [ 12.968487] systemd[1]: Started DHCP Client.1099gitlab # [ 12.970135] systemd[1]: Reached target Network is Online.1100gitlab # [ 40.678886] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: W, [2026-10-25T16:23:47.174428 #904] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 43.334523] postgres[1313]: [1313] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 43.334769] postgres[1313]: [1313] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 43.335530] postgres[1313]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 43.336438] postgres[1313]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 43.337434] postgres[1313]: attidentity AS identity,1106gitlab # [ 43.338241] postgres[1313]: attgenerated as attgenerated1107gitlab # [ 43.339043] postgres[1313]: FROM pg_attribute a1108gitlab # [ 43.339785] postgres[1313]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 43.340795] postgres[1313]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 43.341746] postgres[1313]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 43.343223] postgres[1313]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 43.344178] postgres[1313]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 43.345187] postgres[1313]: ORDER BY a.attnum1114gitlab # [ 43.346123] postgres[1313]:1115gitlab # [ 46.926316] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1346]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 46.927502] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1346]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.114133] gitlab-workhorse[822]: time="2026-10-25T16:23:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.115428] gitlab-workhorse[822]: time="2026-10-25T16:24:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 61.644114] postgres[1421]: [1421] ERROR: relation "table_without_models" does not exist1120gitlab # [ 61.646926] postgres[1421]: [1421] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.125093] gitlab-workhorse[822]: time="2026-10-25T16:24:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 73.117437] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 73.123398] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 73.128712] systemd[1]: Starting gitlab.service...1125gitlab # [ 73.491545] bundle[1579]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 73.492472] bundle[1579]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 73.493380] bundle[1579]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 76.127279] sidekiq-cluster[1578]: {"severity":"INFO","time":"2026-10-25T16:24:22.606Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 76.253127] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.729Z","pid":1579,"message":"* Enabling systemd notification integration"}1130gitlab # [ 76.253820] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"Puma starting in cluster mode..."}1131gitlab # [ 76.254925] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 76.256509] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 76.257963] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"* Min threads: 0"}1134gitlab # [ 76.259925] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"* Max threads: 4"}1135gitlab # [ 76.261434] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"* Environment: production"}1136gitlab # [ 76.262921] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.748Z","pid":1579,"message":"* Master PID: 1579"}1137gitlab # [ 76.264469] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.749Z","pid":1579,"message":"* Workers: 2"}1138gitlab # [ 76.266053] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.749Z","pid":1579,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 76.267185] bundle[1579]: {"timestamp":"2026-10-25T16:24:22.749Z","pid":1579,"message":"* Preloading application"}1140gitlab # [ 78.135218] gitlab-workhorse[822]: time="2026-10-25T16:24:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.145246] gitlab-workhorse[822]: time="2026-10-25T16:24:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.154792] gitlab-workhorse[822]: time="2026-10-25T16:24:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 98.326547] bundle[1579]: W, [2026-10-25T16:24:44.822609 #1579] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 100.313755] sidekiq-cluster[1609]: 2026-10-25T16:24:46.809Z pid=1609 tid=wkh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1609, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434024448}1145gitlab # [ 100.479933] sidekiq-cluster[1609]: W, [2026-10-25T16:24:46.976200 #1609] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 100.517696] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:47.013Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 102.317229] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.812Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 102.317661] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.813Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 102.337619] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.834Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 102.339711] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.836Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 102.342090] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.838Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 102.344290] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.840Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 102.346571] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.842Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 102.348868] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.845Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 102.350780] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.847Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 102.352608] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.848Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 102.354436] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.850Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 102.356352] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.852Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 102.358115] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.854Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 102.360357] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.856Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 102.362154] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.858Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 102.363975] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.860Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 102.365740] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.862Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 102.367555] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.863Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 102.370196] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.866Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 102.372614] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.868Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 102.375394] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.871Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 102.377967] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.874Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 102.380631] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.877Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 102.382821] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.879Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 102.385203] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.881Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 102.387576] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.883Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 102.389640] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.886Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 102.392160] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.888Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 102.394960] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.891Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 102.397358] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.893Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 102.399648] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.896Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 102.402152] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.898Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 102.404548] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.900Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 102.407067] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.903Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 102.409554] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.905Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 102.411837] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.908Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 102.413757] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.910Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 102.415879] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.912Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 102.418262] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.914Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 102.423885] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.920Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 102.429529] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.925Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 102.434758] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.931Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 102.440828] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.937Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 102.446204] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.942Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 102.454946] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.951Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 102.461229] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.957Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 102.467515] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.963Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 102.474551] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.970Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 102.480898] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.977Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 102.485343] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.981Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 102.489406] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.985Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 102.492863] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.989Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 102.496042] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.992Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 102.500797] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:48.997Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 102.519226] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.015Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 102.524039] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.020Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 102.529267] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.025Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 102.534496] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.030Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 102.539429] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.035Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 102.547382] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.043Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 102.550772] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.047Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 102.554508] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.050Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 102.559755] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.056Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 102.564911] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.061Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 102.571400] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.067Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 102.579239] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.075Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 102.584901] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.081Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 102.591544] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.087Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 102.597695] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.094Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 102.602509] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.098Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 102.607578] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.103Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 102.612723] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.108Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 102.651193] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.147Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 102.656843] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.153Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 102.661841] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.158Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 102.667126] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.163Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 102.673643] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.170Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 102.678931] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.175Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 102.684955] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.181Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 102.690804] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.187Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 102.696200] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.192Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 102.701835] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.198Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 102.707590] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.203Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 102.713605] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.209Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 102.720260] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.216Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 102.726214] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.222Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 102.732079] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.228Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 102.738093] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.234Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 102.744334] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.240Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 102.750297] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.246Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 102.755534] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.251Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 102.761442] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.257Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 102.766486] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.262Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 102.772258] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.268Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 102.777270] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.273Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 102.782530] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.278Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 102.789702] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.285Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 102.796455] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.292Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 102.801118] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.297Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 102.806308] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.302Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 102.821491] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.317Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 102.825847] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.321Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 102.829388] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.325Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 102.834279] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.330Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 102.838674] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.335Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 102.846467] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.342Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 102.852665] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.348Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 102.858649] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.354Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 102.863104] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.359Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 102.869430] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.365Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 102.873805] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:24:49.370Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 106.167150] sidekiq-cluster[1609]: InitializerConnections Query: SET client_min_messages TO 'warning'1259gitlab # [ 106.170385] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1260gitlab # [ 106.173847] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1261gitlab # [ 106.176835] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1262gitlab # [ 106.180076] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1263gitlab # [ 106.183228] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1264gitlab # [ 106.186601] sidekiq-cluster[1609]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1265gitlab # [ 106.196654] sidekiq-cluster[1609]: InitializerConnections Query: SET standard_conforming_strings = on1266gitlab # [ 106.199577] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1267gitlab # [ 106.202975] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1268gitlab # [ 106.203572] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1269gitlab # [ 106.205196] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1270gitlab # [ 106.206348] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1271gitlab # [ 106.207856] sidekiq-cluster[1609]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1272gitlab # [ 106.222198] sidekiq-cluster[1609]: InitializerConnections Query: SET intervalstyle = iso_86011273gitlab # [ 106.222312] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1274gitlab # [ 106.223435] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1275gitlab # [ 106.223820] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1276gitlab # [ 106.224939] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1277gitlab # [ 106.226159] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1278gitlab # [ 106.226926] sidekiq-cluster[1609]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1279gitlab # [ 106.251963] sidekiq-cluster[1609]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1280gitlab # [ 106.252586] sidekiq-cluster[1609]: FROM pg_type as t1281gitlab # [ 106.253857] sidekiq-cluster[1609]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1282gitlab # [ 106.255460] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1283gitlab # [ 106.256937] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1284gitlab # [ 106.258452] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1285gitlab # [ 106.259976] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1286gitlab # [ 106.261371] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1287gitlab # [ 106.262264] sidekiq-cluster[1609]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1288gitlab # [ 106.263252] sidekiq-cluster[1609]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1289gitlab # [ 106.264175] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1290gitlab # [ 106.265183] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1291gitlab # [ 106.266204] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1292gitlab # [ 106.267147] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1293gitlab # [ 106.268105] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1294gitlab # [ 106.269062] sidekiq-cluster[1609]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1295gitlab # [ 106.270069] sidekiq-cluster[1609]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1296gitlab # [ 106.270963] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1297gitlab # [ 106.271989] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1298gitlab # [ 106.273238] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1299gitlab # [ 106.274306] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1300gitlab # [ 106.275218] sidekiq-cluster[1609]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1301gitlab # [ 106.276154] sidekiq-cluster[1609]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1302gitlab # [ 108.163882] gitlab-workhorse[822]: time="2026-10-25T16:24:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1303gitlab # [ 118.174778] gitlab-workhorse[822]: time="2026-10-25T16:25:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1304gitlab # [ 126.895116] postgres[2047]: [2047] ERROR: relation "table_without_models" does not exist1305gitlab # [ 126.896329] postgres[2047]: [2047] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1306gitlab # [ 128.176354] gitlab-workhorse[822]: time="2026-10-25T16:25:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1307gitlab # [ 128.389554] postgres[2067]: [2067] ERROR: relation "table_without_models" does not exist1308gitlab # [ 128.390270] postgres[2067]: [2067] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 129.386413] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:15.879Z","message":"Booted Rails 7.2.3.1 application in production environment"}1310gitlab # [ 129.387152] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:15.883Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1311gitlab # [ 129.387798] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:15.883Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1312gitlab # [ 129.388412] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:15.883Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1313gitlab # [ 129.393239] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:15.885Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1314gitlab # [ 130.650507] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:17.146Z","message":"Cleaning working queues"}1315gitlab # [ 130.655364] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:17.151Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"90277beecea04488e990a26a","created_at":"2026-10-25T16:24:19.304Z","trace_propagation_headers":{"sentry-trace":"8d9873abf9fb4298bc64556b2a5f2fbe-94b46586933349ce","baggage":"sentry-trace_id=8d9873abf9fb4298bc64556b2a5f2fbe,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6646a8d4acf98f5b6ecef1df82b49bca","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T16:24:19.312Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-90277beecea04488e990a26a: start","job_status":"start","queue_duration_s":57.83897,"scheduling_latency_s":57.839025}1316gitlab # [ 130.874131] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:17.370Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"90277beecea04488e990a26a","created_at":"2026-10-25T16:24:19.304Z","trace_propagation_headers":{"sentry-trace":"8d9873abf9fb4298bc64556b2a5f2fbe-94b46586933349ce","baggage":"sentry-trace_id=8d9873abf9fb4298bc64556b2a5f2fbe,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6646a8d4acf98f5b6ecef1df82b49bca","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T16:24:19.312Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-90277beecea04488e990a26a: done: 0.218981 sec","job_status":"done","queue_duration_s":57.83897,"scheduling_latency_s":57.839025,"redis_calls":31,"redis_duration_s":0.00965,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.00628,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001981,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09486960000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.218981,"completed_at":"2026-10-25T16:25:17.370Z","load_balancing_strategy":"primary","db_duration_s":0.062564,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1317gitlab # [ 131.167630] bundle[1579]: {"timestamp":"2026-10-25T16:25:17.663Z","pid":1579,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1318gitlab # [ 131.168391] bundle[1579]: {"timestamp":"2026-10-25T16:25:17.663Z","pid":1579,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1319gitlab # [ 131.169259] bundle[1579]: {"timestamp":"2026-10-25T16:25:17.663Z","pid":1579,"message":"! #\u003cThread:0x000079a6029c1810 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1320gitlab # [ 131.170112] bundle[1579]: {"timestamp":"2026-10-25T16:25:17.663Z","pid":1579,"message":"! #\u003cThread:0x000079a602c64e00 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1321gitlab # [ 131.170779] bundle[1579]: {"timestamp":"2026-10-25T16:25:17.663Z","pid":1579,"message":"Use Ctrl-C to stop"}1322gitlab # [ 131.171634] bundle[1579]: {"timestamp":"2026-10-25T16:25:17.663Z","pid":1579,"message":"Sending status to systemd every 1.0 sec"}1323gitlab # [ 131.515172] bundle[1579]: {"timestamp":"2026-10-25T16:25:18.011Z","pid":1579,"message":"- Worker 0 (PID: 2159) booted in 0.29s, phase: 0"}1324gitlab # [ 131.532840] bundle[1579]: {"timestamp":"2026-10-25T16:25:18.029Z","pid":1579,"message":"- Worker 1 (PID: 2163) booted in 0.27s, phase: 0"}1325gitlab # [ 131.538341] systemd[1]: Started gitlab.service.1326gitlab # [ 131.538798] systemd[1]: Reached target Common target for all GitLab services..1327gitlab # [ 131.542190] systemd[1]: Starting setup-gitlab.service...1328gitlab # [ 131.558509] setup-gitlab-start[2187]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1329gitlab # [ 133.800129] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:25:20 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22151330gitlab # [ 133.803130] setup-gitlab-start[2187]: + TOKEN=nixbot-test-token-of-20-chars1331gitlab # [ 133.803438] setup-gitlab-start[2187]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1332gitlab # [ 133.816725] runuser[2209]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1333gitlab # [ 134.205514] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1334gitlab # [ 134.205725] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1335gitlab # [ 134.206906] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1336gitlab # [ 134.898636] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1337gitlab # [ 134.899059] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1338gitlab # [ 134.900907] setup-gitlab-start[2210]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1339gitlab # [ 141.080861] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:27.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"35bcb9187bf181546deefe70","created_at":"2026-10-25T16:25:27.546Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c9b7490ee9ced3582fdeaa6f85bc943","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.574Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-35bcb9187bf181546deefe70: start","job_status":"start","queue_duration_s":0.002276,"scheduling_latency_s":0.00232}1340gitlab # [ 141.177756] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:27.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"35bcb9187bf181546deefe70","created_at":"2026-10-25T16:25:27.546Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c9b7490ee9ced3582fdeaa6f85bc943","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.574Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-35bcb9187bf181546deefe70: done: 0.097251 sec","job_status":"done","queue_duration_s":0.002276,"scheduling_latency_s":0.00232,"redis_calls":10,"redis_duration_s":0.0076359999999999996,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000485816,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.097251,"completed_at":"2026-10-25T16:25:27.673Z","load_balancing_strategy":"primary","db_duration_s":0.017841,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 141.237720] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:27.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"dfa365425df81ef7edb659e4","created_at":"2026-10-25T16:25:27.587Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.593Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-dfa365425df81ef7edb659e4: start","job_status":"start","queue_duration_s":0.140548,"scheduling_latency_s":0.140592}1342gitlab # [ 141.559552] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"dfa365425df81ef7edb659e4","created_at":"2026-10-25T16:25:27.587Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.593Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-dfa365425df81ef7edb659e4: done: 0.321368 sec","job_status":"done","queue_duration_s":0.140548,"scheduling_latency_s":0.140592,"redis_calls":71,"redis_duration_s":0.126508,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.008519,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001297,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.114197,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.135022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011402287,"duration_s":0.321368,"completed_at":"2026-10-25T16:25:28.054Z","load_balancing_strategy":"primary","db_duration_s":0.013628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 141.626445] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"63953c71ebf55a6c92f24390","created_at":"2026-10-25T16:25:27.615Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ea878c132c4c54448ef659bb8f9877b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.625Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-63953c71ebf55a6c92f24390: start","job_status":"start","queue_duration_s":0.49722,"scheduling_latency_s":0.497262}1344gitlab # [ 141.728718] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"63953c71ebf55a6c92f24390","created_at":"2026-10-25T16:25:27.615Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ea878c132c4c54448ef659bb8f9877b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.625Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-63953c71ebf55a6c92f24390: done: 0.102494 sec","job_status":"done","queue_duration_s":0.49722,"scheduling_latency_s":0.497262,"redis_calls":12,"redis_duration_s":0.0183,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.012648,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003373,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001199035,"exclusive_lock_hold_duration_s":0.035748396999999994,"duration_s":0.102494,"completed_at":"2026-10-25T16:25:28.224Z","load_balancing_strategy":"primary","db_duration_s":0.033226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 141.791632] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bf5722d826e8b99d453fe62e","created_at":"2026-10-25T16:25:27.637Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.670Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bf5722d826e8b99d453fe62e: start","job_status":"start","queue_duration_s":0.559009,"scheduling_latency_s":0.559043}1346gitlab # [ 141.803519] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.263Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bf5722d826e8b99d453fe62e","created_at":"2026-10-25T16:25:27.637Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.670Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bf5722d826e8b99d453fe62e: done: 0.03434 sec","job_status":"done","queue_duration_s":0.559009,"scheduling_latency_s":0.559043,"redis_calls":19,"redis_duration_s":0.004745,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001115,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00039,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002414,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284673,"duration_s":0.03434,"completed_at":"2026-10-25T16:25:28.263Z","load_balancing_strategy":"primary","db_duration_s":0.002746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 141.845762] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"422be5ae16110e954122645a","created_at":"2026-10-25T16:25:27.729Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9fb85df3fa73f0fc1fe08a7ac2677b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T16:25:27.740Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-422be5ae16110e954122645a: start","job_status":"start","queue_duration_s":0.524443,"scheduling_latency_s":0.524456}1348gitlab # [ 141.858665] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.272Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1349gitlab # [ 141.862396] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"422be5ae16110e954122645a","created_at":"2026-10-25T16:25:27.729Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9fb85df3fa73f0fc1fe08a7ac2677b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T16:25:27.740Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-422be5ae16110e954122645a: done: 0.01186 sec","job_status":"done","queue_duration_s":0.524443,"scheduling_latency_s":0.524456,"redis_calls":10,"redis_duration_s":0.001991,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265956,"duration_s":0.01186,"completed_at":"2026-10-25T16:25:28.276Z","load_balancing_strategy":"primary","db_duration_s":0.000412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 141.863096] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3c3af5dbee7dafab0999861f","created_at":"2026-10-25T16:25:27.767Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6e63d4cc9a6c8fe2197dd2549fcf457","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.781Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3c3af5dbee7dafab0999861f: start","job_status":"start","queue_duration_s":0.496238,"scheduling_latency_s":0.496251}1351gitlab # [ 141.903123] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.284Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1352gitlab # [ 141.903759] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3c3af5dbee7dafab0999861f","created_at":"2026-10-25T16:25:27.767Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6e63d4cc9a6c8fe2197dd2549fcf457","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.781Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3c3af5dbee7dafab0999861f: done: 0.011874 sec","job_status":"done","queue_duration_s":0.496238,"scheduling_latency_s":0.496251,"redis_calls":10,"redis_duration_s":0.002112,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000266794,"duration_s":0.011874,"completed_at":"2026-10-25T16:25:28.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 141.911615] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c48353e37c5310bb7cee7789","created_at":"2026-10-25T16:25:27.797Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ac6c3fd52c507a53e6fb9aad65155a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T16:25:27.816Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c48353e37c5310bb7cee7789: start","job_status":"start","queue_duration_s":0.473555,"scheduling_latency_s":0.473568}1354gitlab # [ 141.953608] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.298Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1355gitlab # [ 141.954432] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c48353e37c5310bb7cee7789","created_at":"2026-10-25T16:25:27.797Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ac6c3fd52c507a53e6fb9aad65155a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T16:25:27.816Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c48353e37c5310bb7cee7789: done: 0.012476 sec","job_status":"done","queue_duration_s":0.473555,"scheduling_latency_s":0.473568,"redis_calls":10,"redis_duration_s":0.002025,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026372,"duration_s":0.012476,"completed_at":"2026-10-25T16:25:28.302Z","load_balancing_strategy":"primary","db_duration_s":0.000409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 141.962210] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a9b6b0adeaca8e167923bf1b","created_at":"2026-10-25T16:25:27.827Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"860d7fa45592ca814ebbee06eb9017b1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.839Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a9b6b0adeaca8e167923bf1b: start","job_status":"start","queue_duration_s":0.464724,"scheduling_latency_s":0.464737}1357gitlab # [ 142.002313] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a9b6b0adeaca8e167923bf1b","created_at":"2026-10-25T16:25:27.827Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"860d7fa45592ca814ebbee06eb9017b1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.839Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a9b6b0adeaca8e167923bf1b: done: 0.017409 sec","job_status":"done","queue_duration_s":0.464724,"scheduling_latency_s":0.464737,"redis_calls":10,"redis_duration_s":0.002386,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000272102,"duration_s":0.017409,"completed_at":"2026-10-25T16:25:28.321Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 142.010764] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"af0457a8c5ada465d2e0d217","created_at":"2026-10-25T16:25:27.849Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f97f23745da839f54ee3983c5b485bc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.861Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-af0457a8c5ada465d2e0d217: start","job_status":"start","queue_duration_s":0.465213,"scheduling_latency_s":0.465227}1359gitlab # [ 142.058672] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"af0457a8c5ada465d2e0d217","created_at":"2026-10-25T16:25:27.849Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f97f23745da839f54ee3983c5b485bc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.861Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-af0457a8c5ada465d2e0d217: done: 0.037404 sec","job_status":"done","queue_duration_s":0.465213,"scheduling_latency_s":0.465227,"redis_calls":17,"redis_duration_s":0.009262000000000001,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001713,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000174,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004662,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001252394,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.037404,"completed_at":"2026-10-25T16:25:28.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 142.061681] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"aa0d0eb4cf52c95eb91d556d","created_at":"2026-10-25T16:25:27.871Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"177042235ce1d24ce3882ffdb71bea8d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.886Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-aa0d0eb4cf52c95eb91d556d: start","job_status":"start","queue_duration_s":0.481418,"scheduling_latency_s":0.481433}1361gitlab # [ 142.108797] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"aa0d0eb4cf52c95eb91d556d","created_at":"2026-10-25T16:25:27.871Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"177042235ce1d24ce3882ffdb71bea8d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.886Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-aa0d0eb4cf52c95eb91d556d: done: 0.038565 sec","job_status":"done","queue_duration_s":0.481418,"scheduling_latency_s":0.481433,"redis_calls":13,"redis_duration_s":0.007936,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001792,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004235,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.015493029,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.038565,"completed_at":"2026-10-25T16:25:28.406Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012276,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1362gitlab # [ 142.112988] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.407Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7359b7bfaa75d27c70130e97","created_at":"2026-10-25T16:25:27.906Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef7ec998d7d515cf9a46d479550b187b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.917Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7359b7bfaa75d27c70130e97: start","job_status":"start","queue_duration_s":0.489666,"scheduling_latency_s":0.48968}1363gitlab # [ 142.125938] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.414Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1364gitlab # [ 142.129569] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7359b7bfaa75d27c70130e97","created_at":"2026-10-25T16:25:27.906Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef7ec998d7d515cf9a46d479550b187b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.917Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7359b7bfaa75d27c70130e97: done: 0.012378 sec","job_status":"done","queue_duration_s":0.489666,"scheduling_latency_s":0.48968,"redis_calls":10,"redis_duration_s":0.001269,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000429384,"duration_s":0.012378,"completed_at":"2026-10-25T16:25:28.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 142.180185] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"52b765c5a49166fbcdb6527d","created_at":"2026-10-25T16:25:27.936Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27429ebbf7bcd0f032b52321d9c9b070","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.949Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-52b765c5a49166fbcdb6527d: start","job_status":"start","queue_duration_s":0.471587,"scheduling_latency_s":0.471599}1366gitlab # [ 142.180594] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"52b765c5a49166fbcdb6527d","created_at":"2026-10-25T16:25:27.936Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27429ebbf7bcd0f032b52321d9c9b070","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.949Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-52b765c5a49166fbcdb6527d: done: 0.01624 sec","job_status":"done","queue_duration_s":0.471587,"scheduling_latency_s":0.471599,"redis_calls":10,"redis_duration_s":0.001256,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195835,"duration_s":0.01624,"completed_at":"2026-10-25T16:25:28.436Z","load_balancing_strategy":"primary","db_duration_s":0.002328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 142.223980] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e9f63f2f49465d24bd105ecb","created_at":"2026-10-25T16:25:27.958Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e012cc101bd1c43041d81a47f07a417","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.969Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e9f63f2f49465d24bd105ecb: start","job_status":"start","queue_duration_s":0.467783,"scheduling_latency_s":0.467796}1368gitlab # [ 142.226913] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e9f63f2f49465d24bd105ecb","created_at":"2026-10-25T16:25:27.958Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e012cc101bd1c43041d81a47f07a417","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.969Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e9f63f2f49465d24bd105ecb: done: 0.020106 sec","job_status":"done","queue_duration_s":0.467783,"scheduling_latency_s":0.467796,"redis_calls":12,"redis_duration_s":0.002745,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000741,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000350045,"exclusive_lock_hold_duration_s":0.002746438,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.020106,"completed_at":"2026-10-25T16:25:28.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 142.281030] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"503e39d64ea4beb8d0cf5bdb","created_at":"2026-10-25T16:25:27.979Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a722d4fbce1414bb539f47de7d9beeb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.991Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-503e39d64ea4beb8d0cf5bdb: start","job_status":"start","queue_duration_s":0.467225,"scheduling_latency_s":0.46724}1370gitlab # [ 142.281654] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.467Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1371gitlab # [ 142.282219] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.472Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"503e39d64ea4beb8d0cf5bdb","created_at":"2026-10-25T16:25:27.979Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a722d4fbce1414bb539f47de7d9beeb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:27.991Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-503e39d64ea4beb8d0cf5bdb: done: 0.013395 sec","job_status":"done","queue_duration_s":0.467225,"scheduling_latency_s":0.46724,"redis_calls":10,"redis_duration_s":0.001261,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197791,"duration_s":0.013395,"completed_at":"2026-10-25T16:25:28.472Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 142.342506] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ac465cb74cbe97686d341175","created_at":"2026-10-25T16:25:28.012Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15155488b426fcc56cf273d0bc0e50e6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.021Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ac465cb74cbe97686d341175: start","job_status":"start","queue_duration_s":0.451335,"scheduling_latency_s":0.451348}1373gitlab # [ 142.343210] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ac465cb74cbe97686d341175","created_at":"2026-10-25T16:25:28.012Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15155488b426fcc56cf273d0bc0e50e6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.021Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ac465cb74cbe97686d341175: done: 0.078623 sec","job_status":"done","queue_duration_s":0.451335,"scheduling_latency_s":0.451348,"redis_calls":12,"redis_duration_s":0.00178,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000489168,"exclusive_lock_hold_duration_s":0.021961449999999997,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.078623,"completed_at":"2026-10-25T16:25:28.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 142.403942] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7bf765562b165c80936c40a","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7bf765562b165c80936c40a: start","job_status":"start","queue_duration_s":0.528392,"scheduling_latency_s":0.528407}1375gitlab # [ 142.404601] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7bf765562b165c80936c40a","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7bf765562b165c80936c40a: done: 0.016188 sec","job_status":"done","queue_duration_s":0.528392,"scheduling_latency_s":0.528407,"redis_calls":16,"redis_duration_s":0.002158,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204775,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016188,"completed_at":"2026-10-25T16:25:28.569Z","load_balancing_strategy":"primary","db_duration_s":0.001407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 142.415869] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d80e529ebbec1e83594d102","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d80e529ebbec1e83594d102: start","job_status":"start","queue_duration_s":0.545445,"scheduling_latency_s":0.545458}1377gitlab # [ 142.456706] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d80e529ebbec1e83594d102","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d80e529ebbec1e83594d102: done: 0.009972 sec","job_status":"done","queue_duration_s":0.545445,"scheduling_latency_s":0.545458,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009972,"completed_at":"2026-10-25T16:25:28.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 142.460543] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb2b8e80ef7f10ab3d9cc9e7","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb2b8e80ef7f10ab3d9cc9e7: start","job_status":"start","queue_duration_s":0.556495,"scheduling_latency_s":0.556508}1379gitlab # [ 142.471604] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb2b8e80ef7f10ab3d9cc9e7","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb2b8e80ef7f10ab3d9cc9e7: done: 0.00998 sec","job_status":"done","queue_duration_s":0.556495,"scheduling_latency_s":0.556508,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00998,"completed_at":"2026-10-25T16:25:28.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 142.536931] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8050a6784525d4f67b798aae","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8050a6784525d4f67b798aae: start","job_status":"start","queue_duration_s":0.567585,"scheduling_latency_s":0.567597}1381gitlab # [ 142.537622] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8050a6784525d4f67b798aae","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8050a6784525d4f67b798aae: done: 0.009637 sec","job_status":"done","queue_duration_s":0.567585,"scheduling_latency_s":0.567597,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009637,"completed_at":"2026-10-25T16:25:28.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 142.551526] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3bd3fa2ab2620aea99fbee1","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3bd3fa2ab2620aea99fbee1: start","job_status":"start","queue_duration_s":0.578235,"scheduling_latency_s":0.578249}1383gitlab # [ 142.594224] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3bd3fa2ab2620aea99fbee1","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3bd3fa2ab2620aea99fbee1: done: 0.009748 sec","job_status":"done","queue_duration_s":0.578235,"scheduling_latency_s":0.578249,"redis_calls":13,"redis_duration_s":0.0017170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009748,"completed_at":"2026-10-25T16:25:28.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 142.596177] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21d9d3696c1a98bdf21d9725","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21d9d3696c1a98bdf21d9725: start","job_status":"start","queue_duration_s":0.588825,"scheduling_latency_s":0.588838}1385gitlab # [ 142.607257] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21d9d3696c1a98bdf21d9725","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21d9d3696c1a98bdf21d9725: done: 0.009772 sec","job_status":"done","queue_duration_s":0.588825,"scheduling_latency_s":0.588838,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-10-25T16:25:28.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 142.642184] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd683cc8c3af5fc17341d33","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd683cc8c3af5fc17341d33: start","job_status":"start","queue_duration_s":0.599585,"scheduling_latency_s":0.599599}1387gitlab # [ 142.653219] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd683cc8c3af5fc17341d33","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd683cc8c3af5fc17341d33: done: 0.009683 sec","job_status":"done","queue_duration_s":0.599585,"scheduling_latency_s":0.599599,"redis_calls":13,"redis_duration_s":0.0017039999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009683,"completed_at":"2026-10-25T16:25:28.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 142.696455] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd11135581702e954a8b9f11","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd11135581702e954a8b9f11: start","job_status":"start","queue_duration_s":0.610101,"scheduling_latency_s":0.610114}1389gitlab # [ 142.697657] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd11135581702e954a8b9f11","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd11135581702e954a8b9f11: done: 0.009671 sec","job_status":"done","queue_duration_s":0.610101,"scheduling_latency_s":0.610114,"redis_calls":13,"redis_duration_s":0.001538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009671,"completed_at":"2026-10-25T16:25:28.644Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 142.738257] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e87a84a0c60545983b0dc97","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e87a84a0c60545983b0dc97: start","job_status":"start","queue_duration_s":0.620594,"scheduling_latency_s":0.620608}1391gitlab # [ 142.742024] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e87a84a0c60545983b0dc97","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e87a84a0c60545983b0dc97: done: 0.009754 sec","job_status":"done","queue_duration_s":0.620594,"scheduling_latency_s":0.620608,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009754,"completed_at":"2026-10-25T16:25:28.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 142.785247] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5573c22509501fa5effea21b","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5573c22509501fa5effea21b: start","job_status":"start","queue_duration_s":0.631354,"scheduling_latency_s":0.631366}1393gitlab # [ 142.786628] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5573c22509501fa5effea21b","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5573c22509501fa5effea21b: done: 0.009972 sec","job_status":"done","queue_duration_s":0.631354,"scheduling_latency_s":0.631366,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009972,"completed_at":"2026-10-25T16:25:28.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 142.830476] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51c59ab67b07ddb5fcf4eb81","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51c59ab67b07ddb5fcf4eb81: start","job_status":"start","queue_duration_s":0.642315,"scheduling_latency_s":0.642328}1395gitlab # [ 142.831144] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51c59ab67b07ddb5fcf4eb81","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51c59ab67b07ddb5fcf4eb81: done: 0.009531 sec","job_status":"done","queue_duration_s":0.642315,"scheduling_latency_s":0.642328,"redis_calls":13,"redis_duration_s":0.001597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009531,"completed_at":"2026-10-25T16:25:28.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 142.887619] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aadc9fbdc28966a76dad6e41","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aadc9fbdc28966a76dad6e41: start","job_status":"start","queue_duration_s":0.652834,"scheduling_latency_s":0.652846}1397gitlab # [ 142.888513] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aadc9fbdc28966a76dad6e41","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aadc9fbdc28966a76dad6e41: done: 0.009559 sec","job_status":"done","queue_duration_s":0.652834,"scheduling_latency_s":0.652846,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009559,"completed_at":"2026-10-25T16:25:28.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 142.932584] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42f9938633245663b68e977","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42f9938633245663b68e977: start","job_status":"start","queue_duration_s":0.663387,"scheduling_latency_s":0.6634}1399gitlab # [ 142.933474] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42f9938633245663b68e977","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42f9938633245663b68e977: done: 0.009828 sec","job_status":"done","queue_duration_s":0.663387,"scheduling_latency_s":0.6634,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009828,"completed_at":"2026-10-25T16:25:28.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 142.984060] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aea66df245e531d47ae8ee2","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aea66df245e531d47ae8ee2: start","job_status":"start","queue_duration_s":0.674203,"scheduling_latency_s":0.674216}1401gitlab # [ 142.984817] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aea66df245e531d47ae8ee2","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aea66df245e531d47ae8ee2: done: 0.009531 sec","job_status":"done","queue_duration_s":0.674203,"scheduling_latency_s":0.674216,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009531,"completed_at":"2026-10-25T16:25:28.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 143.023757] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fbcf531f635a2f1a5e4b032","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fbcf531f635a2f1a5e4b032: start","job_status":"start","queue_duration_s":0.684854,"scheduling_latency_s":0.684866}1403gitlab # [ 143.024545] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fbcf531f635a2f1a5e4b032","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fbcf531f635a2f1a5e4b032: done: 0.010385 sec","job_status":"done","queue_duration_s":0.684854,"scheduling_latency_s":0.684866,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010385,"completed_at":"2026-10-25T16:25:28.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 143.045156] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bba480e155537c2ba10907c","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bba480e155537c2ba10907c: start","job_status":"start","queue_duration_s":0.696089,"scheduling_latency_s":0.696102}1405gitlab # [ 143.091069] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bba480e155537c2ba10907c","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bba480e155537c2ba10907c: done: 0.009593 sec","job_status":"done","queue_duration_s":0.696089,"scheduling_latency_s":0.696102,"redis_calls":13,"redis_duration_s":0.001735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009593,"completed_at":"2026-10-25T16:25:28.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 143.092077] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c30a4139a37e42b94dc058f8","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c30a4139a37e42b94dc058f8: start","job_status":"start","queue_duration_s":0.706682,"scheduling_latency_s":0.706705}1407gitlab # [ 143.132571] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c30a4139a37e42b94dc058f8","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c30a4139a37e42b94dc058f8: done: 0.009711 sec","job_status":"done","queue_duration_s":0.706682,"scheduling_latency_s":0.706705,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009711,"completed_at":"2026-10-25T16:25:28.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 143.134635] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"158d2a0d84e28e369de6e7a9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-158d2a0d84e28e369de6e7a9: start","job_status":"start","queue_duration_s":0.717296,"scheduling_latency_s":0.717309}1409gitlab # [ 143.145726] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"158d2a0d84e28e369de6e7a9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-158d2a0d84e28e369de6e7a9: done: 0.00974 sec","job_status":"done","queue_duration_s":0.717296,"scheduling_latency_s":0.717309,"redis_calls":13,"redis_duration_s":0.001905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00974,"completed_at":"2026-10-25T16:25:28.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 143.210279] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"141055592fbdd0f1c24e342e","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-141055592fbdd0f1c24e342e: start","job_status":"start","queue_duration_s":0.727837,"scheduling_latency_s":0.727849}1411gitlab # [ 143.210957] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"141055592fbdd0f1c24e342e","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-141055592fbdd0f1c24e342e: done: 0.009667 sec","job_status":"done","queue_duration_s":0.727837,"scheduling_latency_s":0.727849,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009667,"completed_at":"2026-10-25T16:25:28.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 143.249620] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78d8abfc1482ae99d967fc85","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78d8abfc1482ae99d967fc85: start","job_status":"start","queue_duration_s":0.738399,"scheduling_latency_s":0.738411}1413gitlab # [ 143.250498] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78d8abfc1482ae99d967fc85","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78d8abfc1482ae99d967fc85: done: 0.009694 sec","job_status":"done","queue_duration_s":0.738399,"scheduling_latency_s":0.738411,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009694,"completed_at":"2026-10-25T16:25:28.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 143.290612] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91a2c0c8edef4313937a24e4","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91a2c0c8edef4313937a24e4: start","job_status":"start","queue_duration_s":0.749067,"scheduling_latency_s":0.749081}1415gitlab # [ 143.291215] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91a2c0c8edef4313937a24e4","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91a2c0c8edef4313937a24e4: done: 0.009547 sec","job_status":"done","queue_duration_s":0.749067,"scheduling_latency_s":0.749081,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009547,"completed_at":"2026-10-25T16:25:28.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 143.336928] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0aa16b547ffd8ad32f8b9a8f","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0aa16b547ffd8ad32f8b9a8f: start","job_status":"start","queue_duration_s":0.7596,"scheduling_latency_s":0.759613}1417gitlab # [ 143.337640] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0aa16b547ffd8ad32f8b9a8f","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0aa16b547ffd8ad32f8b9a8f: done: 0.010894 sec","job_status":"done","queue_duration_s":0.7596,"scheduling_latency_s":0.759613,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010894,"completed_at":"2026-10-25T16:25:28.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 143.381662] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e39373b7eaa1a4f6b3652d7e","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e39373b7eaa1a4f6b3652d7e: start","job_status":"start","queue_duration_s":0.771468,"scheduling_latency_s":0.771481}1419gitlab # [ 143.382518] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e39373b7eaa1a4f6b3652d7e","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e39373b7eaa1a4f6b3652d7e: done: 0.009748 sec","job_status":"done","queue_duration_s":0.771468,"scheduling_latency_s":0.771481,"redis_calls":13,"redis_duration_s":0.0015470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009748,"completed_at":"2026-10-25T16:25:28.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 143.428544] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e252397cea289c0aa6fecd1","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e252397cea289c0aa6fecd1: start","job_status":"start","queue_duration_s":0.782203,"scheduling_latency_s":0.782216}1421gitlab # [ 143.429455] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e252397cea289c0aa6fecd1","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e252397cea289c0aa6fecd1: done: 0.009859 sec","job_status":"done","queue_duration_s":0.782203,"scheduling_latency_s":0.782216,"redis_calls":13,"redis_duration_s":0.0018740000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001324,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009859,"completed_at":"2026-10-25T16:25:28.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 143.449592] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eb81cfcf9d3f823e6a233f3","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eb81cfcf9d3f823e6a233f3: start","job_status":"start","queue_duration_s":0.793424,"scheduling_latency_s":0.793453}1423gitlab # [ 143.487229] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eb81cfcf9d3f823e6a233f3","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eb81cfcf9d3f823e6a233f3: done: 0.012564 sec","job_status":"done","queue_duration_s":0.793424,"scheduling_latency_s":0.793453,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012564,"completed_at":"2026-10-25T16:25:28.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 143.494417] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845539b8224c81daa5c09069","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845539b8224c81daa5c09069: start","job_status":"start","queue_duration_s":0.806952,"scheduling_latency_s":0.806966}1425gitlab # [ 143.505523] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845539b8224c81daa5c09069","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845539b8224c81daa5c09069: done: 0.009532 sec","job_status":"done","queue_duration_s":0.806952,"scheduling_latency_s":0.806966,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009532,"completed_at":"2026-10-25T16:25:28.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 143.566911] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7643e555237181c66d96d4c6","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7643e555237181c66d96d4c6: start","job_status":"start","queue_duration_s":0.81731,"scheduling_latency_s":0.817322}1427gitlab # [ 143.567644] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7643e555237181c66d96d4c6","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7643e555237181c66d96d4c6: done: 0.009489 sec","job_status":"done","queue_duration_s":0.81731,"scheduling_latency_s":0.817322,"redis_calls":13,"redis_duration_s":0.001585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009489,"completed_at":"2026-10-25T16:25:28.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 143.617485] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d416629a1f56de10ae674745","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d416629a1f56de10ae674745: start","job_status":"start","queue_duration_s":0.8276,"scheduling_latency_s":0.827613}1429gitlab # [ 143.618243] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d416629a1f56de10ae674745","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d416629a1f56de10ae674745: done: 0.009564 sec","job_status":"done","queue_duration_s":0.8276,"scheduling_latency_s":0.827613,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009564,"completed_at":"2026-10-25T16:25:28.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 143.629552] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3ecdd7aae24895176a4d4c","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3ecdd7aae24895176a4d4c: start","job_status":"start","queue_duration_s":0.838025,"scheduling_latency_s":0.838037}1431gitlab # [ 143.673176] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3ecdd7aae24895176a4d4c","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3ecdd7aae24895176a4d4c: done: 0.009515 sec","job_status":"done","queue_duration_s":0.838025,"scheduling_latency_s":0.838037,"redis_calls":13,"redis_duration_s":0.0014979999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009515,"completed_at":"2026-10-25T16:25:28.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 143.674431] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96a95cac70152a26a5d8e059","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96a95cac70152a26a5d8e059: start","job_status":"start","queue_duration_s":0.848479,"scheduling_latency_s":0.848491}1433gitlab # [ 143.713266] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96a95cac70152a26a5d8e059","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96a95cac70152a26a5d8e059: done: 0.009372 sec","job_status":"done","queue_duration_s":0.848479,"scheduling_latency_s":0.848491,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-10-25T16:25:28.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 143.718868] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a97672a87f0c2fc0d740598","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a97672a87f0c2fc0d740598: start","job_status":"start","queue_duration_s":0.858644,"scheduling_latency_s":0.858656}1435gitlab # [ 143.758609] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a97672a87f0c2fc0d740598","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a97672a87f0c2fc0d740598: done: 0.009246 sec","job_status":"done","queue_duration_s":0.858644,"scheduling_latency_s":0.858656,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009246,"completed_at":"2026-10-25T16:25:28.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 143.797032] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42a427374ab29b34e736819f","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42a427374ab29b34e736819f: start","job_status":"start","queue_duration_s":0.868818,"scheduling_latency_s":0.868832}1437gitlab # [ 143.797705] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42a427374ab29b34e736819f","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42a427374ab29b34e736819f: done: 0.009476 sec","job_status":"done","queue_duration_s":0.868818,"scheduling_latency_s":0.868832,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009476,"completed_at":"2026-10-25T16:25:28.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 143.808076] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f6a1d0833c2f886cc6f5711","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f6a1d0833c2f886cc6f5711: start","job_status":"start","queue_duration_s":0.879261,"scheduling_latency_s":0.879273}1439gitlab # [ 143.819168] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f6a1d0833c2f886cc6f5711","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f6a1d0833c2f886cc6f5711: done: 0.009808 sec","job_status":"done","queue_duration_s":0.879261,"scheduling_latency_s":0.879273,"redis_calls":13,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009808,"completed_at":"2026-10-25T16:25:28.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 143.883229] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b5643afc224e8596f8ec2f6","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b5643afc224e8596f8ec2f6: start","job_status":"start","queue_duration_s":0.890049,"scheduling_latency_s":0.890062}1441gitlab # [ 143.883931] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b5643afc224e8596f8ec2f6","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b5643afc224e8596f8ec2f6: done: 0.009444 sec","job_status":"done","queue_duration_s":0.890049,"scheduling_latency_s":0.890062,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009444,"completed_at":"2026-10-25T16:25:28.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 143.898570] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98b84a2c22e2eb5dbf28f4fb","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98b84a2c22e2eb5dbf28f4fb: start","job_status":"start","queue_duration_s":0.900471,"scheduling_latency_s":0.900484}1443gitlab # [ 143.909587] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98b84a2c22e2eb5dbf28f4fb","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98b84a2c22e2eb5dbf28f4fb: done: 0.009299 sec","job_status":"done","queue_duration_s":0.900471,"scheduling_latency_s":0.900484,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009299,"completed_at":"2026-10-25T16:25:28.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 143.955764] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dece04b1195dd6b381c2ada","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dece04b1195dd6b381c2ada: start","job_status":"start","queue_duration_s":0.910692,"scheduling_latency_s":0.910713}1445gitlab # [ 143.956614] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dece04b1195dd6b381c2ada","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dece04b1195dd6b381c2ada: done: 0.009418 sec","job_status":"done","queue_duration_s":0.910692,"scheduling_latency_s":0.910713,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009418,"completed_at":"2026-10-25T16:25:28.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 144.007505] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc8818d3377692532576c88e","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc8818d3377692532576c88e: start","job_status":"start","queue_duration_s":0.920909,"scheduling_latency_s":0.920922}1447gitlab # [ 144.008262] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc8818d3377692532576c88e","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc8818d3377692532576c88e: done: 0.011568 sec","job_status":"done","queue_duration_s":0.920909,"scheduling_latency_s":0.920922,"redis_calls":13,"redis_duration_s":0.0016940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011568,"completed_at":"2026-10-25T16:25:28.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 144.055680] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6200478e22c7a468a938cae7","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6200478e22c7a468a938cae7: start","job_status":"start","queue_duration_s":0.933498,"scheduling_latency_s":0.933517}1449gitlab # [ 144.056446] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6200478e22c7a468a938cae7","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6200478e22c7a468a938cae7: done: 0.010526 sec","job_status":"done","queue_duration_s":0.933498,"scheduling_latency_s":0.933517,"redis_calls":13,"redis_duration_s":0.001781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010526,"completed_at":"2026-10-25T16:25:28.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 144.104284] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6af73f6fc9f38474cc614e94","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6af73f6fc9f38474cc614e94: start","job_status":"start","queue_duration_s":0.944811,"scheduling_latency_s":0.944824}1451gitlab # [ 144.105107] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6af73f6fc9f38474cc614e94","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6af73f6fc9f38474cc614e94: done: 0.009657 sec","job_status":"done","queue_duration_s":0.944811,"scheduling_latency_s":0.944824,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009657,"completed_at":"2026-10-25T16:25:28.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 144.146420] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edf97c31426ffd0047d57c78","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edf97c31426ffd0047d57c78: start","job_status":"start","queue_duration_s":0.955479,"scheduling_latency_s":0.955491}1453gitlab # [ 144.147184] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edf97c31426ffd0047d57c78","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edf97c31426ffd0047d57c78: done: 0.009708 sec","job_status":"done","queue_duration_s":0.955479,"scheduling_latency_s":0.955491,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009708,"completed_at":"2026-10-25T16:25:28.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 144.199123] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:28.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"397c929ebe3ef84c24aef3d9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-397c929ebe3ef84c24aef3d9: start","job_status":"start","queue_duration_s":0.966082,"scheduling_latency_s":0.966094}1455gitlab # [ 144.199842] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"397c929ebe3ef84c24aef3d9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-397c929ebe3ef84c24aef3d9: done: 0.009521 sec","job_status":"done","queue_duration_s":0.966082,"scheduling_latency_s":0.966094,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009521,"completed_at":"2026-10-25T16:25:29.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 144.212556] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fb0cbf822077ce6534f56b9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fb0cbf822077ce6534f56b9: start","job_status":"start","queue_duration_s":0.97659,"scheduling_latency_s":0.976603}1457gitlab # [ 144.255276] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fb0cbf822077ce6534f56b9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fb0cbf822077ce6534f56b9: done: 0.009537 sec","job_status":"done","queue_duration_s":0.97659,"scheduling_latency_s":0.976603,"redis_calls":13,"redis_duration_s":0.001579,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009537,"completed_at":"2026-10-25T16:25:29.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 144.257541] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e4cfb7165982d42047a8091","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e4cfb7165982d42047a8091: start","job_status":"start","queue_duration_s":0.987114,"scheduling_latency_s":0.987126}1459gitlab # [ 144.294905] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e4cfb7165982d42047a8091","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e4cfb7165982d42047a8091: done: 0.010217 sec","job_status":"done","queue_duration_s":0.987114,"scheduling_latency_s":0.987126,"redis_calls":13,"redis_duration_s":0.0016059999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010217,"completed_at":"2026-10-25T16:25:29.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 144.302131] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85139b3864f4cb147893a201","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85139b3864f4cb147893a201: start","job_status":"start","queue_duration_s":0.998299,"scheduling_latency_s":0.998313}1461gitlab # [ 144.313303] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85139b3864f4cb147893a201","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85139b3864f4cb147893a201: done: 0.009591 sec","job_status":"done","queue_duration_s":0.998299,"scheduling_latency_s":0.998313,"redis_calls":13,"redis_duration_s":0.001607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009591,"completed_at":"2026-10-25T16:25:29.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 144.354650] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4eae3fa674d1adcfa1a2d371","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4eae3fa674d1adcfa1a2d371: start","job_status":"start","queue_duration_s":1.008861,"scheduling_latency_s":1.008874}1463gitlab # [ 144.394301] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4eae3fa674d1adcfa1a2d371","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4eae3fa674d1adcfa1a2d371: done: 0.009699 sec","job_status":"done","queue_duration_s":1.008861,"scheduling_latency_s":1.008874,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009699,"completed_at":"2026-10-25T16:25:29.043Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 144.395474] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc3137a7b36d42470cdad69b","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc3137a7b36d42470cdad69b: start","job_status":"start","queue_duration_s":1.019552,"scheduling_latency_s":1.019565}1465gitlab # [ 144.437308] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc3137a7b36d42470cdad69b","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc3137a7b36d42470cdad69b: done: 0.009663 sec","job_status":"done","queue_duration_s":1.019552,"scheduling_latency_s":1.019565,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009663,"completed_at":"2026-10-25T16:25:29.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 144.438408] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a51e4b2bf585f87ae110e38","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a51e4b2bf585f87ae110e38: start","job_status":"start","queue_duration_s":1.030046,"scheduling_latency_s":1.030058}1467gitlab # [ 144.480173] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a51e4b2bf585f87ae110e38","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a51e4b2bf585f87ae110e38: done: 0.009673 sec","job_status":"done","queue_duration_s":1.030046,"scheduling_latency_s":1.030058,"redis_calls":13,"redis_duration_s":0.001746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009673,"completed_at":"2026-10-25T16:25:29.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 144.481386] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ab17e9f0d87b1057d8e1ed6","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ab17e9f0d87b1057d8e1ed6: start","job_status":"start","queue_duration_s":1.040545,"scheduling_latency_s":1.040558}1469gitlab # [ 144.492531] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ab17e9f0d87b1057d8e1ed6","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ab17e9f0d87b1057d8e1ed6: done: 0.009658 sec","job_status":"done","queue_duration_s":1.040545,"scheduling_latency_s":1.040558,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009658,"completed_at":"2026-10-25T16:25:29.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 144.540277] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e34608a7fcc44352a13484bc","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e34608a7fcc44352a13484bc: start","job_status":"start","queue_duration_s":1.051129,"scheduling_latency_s":1.051141}1471gitlab # [ 144.541069] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e34608a7fcc44352a13484bc","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e34608a7fcc44352a13484bc: done: 0.009866 sec","job_status":"done","queue_duration_s":1.051129,"scheduling_latency_s":1.051141,"redis_calls":13,"redis_duration_s":0.0018939999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009866,"completed_at":"2026-10-25T16:25:29.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 144.581777] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e87fb890644ec1347192a5d9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e87fb890644ec1347192a5d9: start","job_status":"start","queue_duration_s":1.061807,"scheduling_latency_s":1.061819}1473gitlab # [ 144.620437] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e87fb890644ec1347192a5d9","created_at":"2026-10-25T16:25:27.798Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-5559905545144482","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"31594b0ebec0a1f1c1ee875f4ac4a982","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.024Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e87fb890644ec1347192a5d9: done: 0.009594 sec","job_status":"done","queue_duration_s":1.061807,"scheduling_latency_s":1.061819,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009594,"completed_at":"2026-10-25T16:25:29.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 144.621756] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"711556b872a64a90697dbfcb","created_at":"2026-10-25T16:25:28.044Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"026a82512587569e4b0cb9f703ff8bd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.121Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-711556b872a64a90697dbfcb: start","job_status":"start","queue_duration_s":0.975718,"scheduling_latency_s":0.97573}1475gitlab # [ 144.667663] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"711556b872a64a90697dbfcb","created_at":"2026-10-25T16:25:28.044Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"026a82512587569e4b0cb9f703ff8bd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.121Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-711556b872a64a90697dbfcb: done: 0.014613 sec","job_status":"done","queue_duration_s":0.975718,"scheduling_latency_s":0.97573,"redis_calls":12,"redis_duration_s":0.001582,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220978,"duration_s":0.014613,"completed_at":"2026-10-25T16:25:29.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 144.669259] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c343f5a31a8712efc1639f93","created_at":"2026-10-25T16:25:28.153Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a7dd80000c6ca605026eb6cdc9f9d26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.159Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c343f5a31a8712efc1639f93: start","job_status":"start","queue_duration_s":0.952623,"scheduling_latency_s":0.952636}1477gitlab # [ 144.680835] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c343f5a31a8712efc1639f93","created_at":"2026-10-25T16:25:28.153Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a7dd80000c6ca605026eb6cdc9f9d26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.159Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c343f5a31a8712efc1639f93: done: 0.710919 sec","job_status":"done","queue_duration_s":0.952623,"scheduling_latency_s":0.952636,"redis_calls":14,"redis_duration_s":0.002272,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00069,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.074,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000305625,"exclusive_lock_hold_duration_s":0.695838996,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.710919,"completed_at":"2026-10-25T16:25:29.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.61297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 144.748143] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b296e954a93dec71cfbfe32b","created_at":"2026-10-25T16:25:28.180Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df156941a631f50468326bdf5efa505e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.190Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b296e954a93dec71cfbfe32b: start","job_status":"start","queue_duration_s":1.63402,"scheduling_latency_s":1.634034}1479gitlab # [ 144.748876] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b296e954a93dec71cfbfe32b","created_at":"2026-10-25T16:25:28.180Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df156941a631f50468326bdf5efa505e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.190Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b296e954a93dec71cfbfe32b: done: 0.024967 sec","job_status":"done","queue_duration_s":1.63402,"scheduling_latency_s":1.634034,"redis_calls":12,"redis_duration_s":0.0022,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000354514,"exclusive_lock_hold_duration_s":0.011471849,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.024967,"completed_at":"2026-10-25T16:25:29.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 144.796070] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.850Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c33f2f2114463c2b784ab959","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c33f2f2114463c2b784ab959: start","job_status":"start","queue_duration_s":1.592231,"scheduling_latency_s":1.592244}1481gitlab # [ 144.796712] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.895Z","message":"No existing merge request to be cleaned up."}1482gitlab # [ 144.797408] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.904Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c33f2f2114463c2b784ab959","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c33f2f2114463c2b784ab959: done: 0.053769 sec","job_status":"done","queue_duration_s":1.592231,"scheduling_latency_s":1.592244,"redis_calls":13,"redis_duration_s":0.001789,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236622,"duration_s":0.053769,"completed_at":"2026-10-25T16:25:29.904Z","load_balancing_strategy":"primary","db_duration_s":0.002575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 144.837667] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.905Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7737bdd2738e0a01355af631","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7737bdd2738e0a01355af631: start","job_status":"start","queue_duration_s":1.646908,"scheduling_latency_s":1.646924}1484gitlab # [ 144.838471] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.911Z","message":"No existing merge request to be cleaned up."}1485gitlab # [ 144.838991] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.916Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7737bdd2738e0a01355af631","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7737bdd2738e0a01355af631: done: 0.010849 sec","job_status":"done","queue_duration_s":1.646908,"scheduling_latency_s":1.646924,"redis_calls":10,"redis_duration_s":0.001212,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010849,"completed_at":"2026-10-25T16:25:29.916Z","load_balancing_strategy":"primary","db_duration_s":0.000985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 144.896898] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.916Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1728146bce8fc082672740d3","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1728146bce8fc082672740d3: start","job_status":"start","queue_duration_s":1.658568,"scheduling_latency_s":1.658581}1487gitlab # [ 144.897590] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.923Z","message":"No existing merge request to be cleaned up."}1488gitlab # [ 144.898170] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.927Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1728146bce8fc082672740d3","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1728146bce8fc082672740d3: done: 0.010597 sec","job_status":"done","queue_duration_s":1.658568,"scheduling_latency_s":1.658581,"redis_calls":10,"redis_duration_s":0.001444,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010597,"completed_at":"2026-10-25T16:25:29.927Z","load_balancing_strategy":"primary","db_duration_s":0.000924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 144.943842] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.928Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"30bbb531a07459545b042f9b","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-30bbb531a07459545b042f9b: start","job_status":"start","queue_duration_s":1.670061,"scheduling_latency_s":1.670075}1490gitlab # [ 144.944520] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.936Z","message":"No existing merge request to be cleaned up."}1491gitlab # [ 144.945087] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.942Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"30bbb531a07459545b042f9b","created_at":"2026-10-25T16:25:28.246Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-af4a5f9300ff469b","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99bc70b2fa2a44e40b2020042b590a56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.258Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-30bbb531a07459545b042f9b: done: 0.013874 sec","job_status":"done","queue_duration_s":1.670061,"scheduling_latency_s":1.670075,"redis_calls":10,"redis_duration_s":0.001271,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013874,"completed_at":"2026-10-25T16:25:29.942Z","load_balancing_strategy":"primary","db_duration_s":0.00429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 144.990029] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9a0ab88182a6a07925b79515","created_at":"2026-10-25T16:25:28.222Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d41759864e400f2b147d9eac7ff98ee9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.323Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9a0ab88182a6a07925b79515: start","job_status":"start","queue_duration_s":1.619598,"scheduling_latency_s":1.619612}1493gitlab # [ 144.990705] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9a0ab88182a6a07925b79515","created_at":"2026-10-25T16:25:28.222Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d41759864e400f2b147d9eac7ff98ee9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.323Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9a0ab88182a6a07925b79515: done: 0.011269 sec","job_status":"done","queue_duration_s":1.619598,"scheduling_latency_s":1.619612,"redis_calls":10,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234108,"duration_s":0.011269,"completed_at":"2026-10-25T16:25:29.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 145.006657] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:29.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fe294cd5d4d3826c1c6f457f","created_at":"2026-10-25T16:25:28.326Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ced72fc8024e3fc81f357529e347db60","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.337Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fe294cd5d4d3826c1c6f457f: start","job_status":"start","queue_duration_s":1.617247,"scheduling_latency_s":1.61726}1495gitlab # [ 145.047268] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.163Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fe294cd5d4d3826c1c6f457f","created_at":"2026-10-25T16:25:28.326Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ced72fc8024e3fc81f357529e347db60","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.337Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fe294cd5d4d3826c1c6f457f: done: 0.208156 sec","job_status":"done","queue_duration_s":1.617247,"scheduling_latency_s":1.61726,"redis_calls":565,"redis_duration_s":0.059659,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.058689,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.169208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021567,"duration_s":0.208156,"completed_at":"2026-10-25T16:25:30.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 145.055490] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c12fbf9313fb4a93976ce7f1","created_at":"2026-10-25T16:25:28.343Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83db8e1db66d9651389fd4de02172438","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.350Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c12fbf9313fb4a93976ce7f1: start","job_status":"start","queue_duration_s":1.813994,"scheduling_latency_s":1.814007}1497gitlab # [ 145.099139] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.174Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1498gitlab # [ 145.099826] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c12fbf9313fb4a93976ce7f1","created_at":"2026-10-25T16:25:28.343Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83db8e1db66d9651389fd4de02172438","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.350Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c12fbf9313fb4a93976ce7f1: done: 0.01428 sec","job_status":"done","queue_duration_s":1.813994,"scheduling_latency_s":1.814007,"redis_calls":10,"redis_duration_s":0.001265,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196393,"duration_s":0.01428,"completed_at":"2026-10-25T16:25:30.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 145.140429] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0c40a9f2f188335c90788366","created_at":"2026-10-25T16:25:28.353Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8015e2a332d0242432413fa4fcfac269","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-25T16:25:28.366Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0c40a9f2f188335c90788366: start","job_status":"start","queue_duration_s":1.813636,"scheduling_latency_s":1.813649}1500gitlab # [ 145.141052] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0c40a9f2f188335c90788366","created_at":"2026-10-25T16:25:28.353Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8015e2a332d0242432413fa4fcfac269","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-25T16:25:28.366Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0c40a9f2f188335c90788366: done: 0.017602 sec","job_status":"done","queue_duration_s":1.813636,"scheduling_latency_s":1.813649,"redis_calls":10,"redis_duration_s":0.001264,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218463,"duration_s":0.017602,"completed_at":"2026-10-25T16:25:30.197Z","load_balancing_strategy":"primary","db_duration_s":0.002122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 145.186414] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.198Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ac7675310b80aaf0cc053257","created_at":"2026-10-25T16:25:28.375Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"290c31c71dd99a27023a0a74b2a41f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.386Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ac7675310b80aaf0cc053257: start","job_status":"start","queue_duration_s":1.811966,"scheduling_latency_s":1.811978}1502gitlab # [ 145.187181] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:25:30.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ac7675310b80aaf0cc053257","created_at":"2026-10-25T16:25:28.375Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"290c31c71dd99a27023a0a74b2a41f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-25T16:25:28.386Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ac7675310b80aaf0cc053257: done: 0.014564 sec","job_status":"done","queue_duration_s":1.811966,"scheduling_latency_s":1.811978,"redis_calls":10,"redis_duration_s":0.001302,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240533,"duration_s":0.014564,"completed_at":"2026-10-25T16:25:30.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 145.391288] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2964180854 wd_nsec: 29641797641504gitlab # [ 159.947496] setup-gitlab-start[2210]: W, [2026-10-25T16:25:46.443164 #2210] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1505gitlab # [ 176.412345] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:02.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a95f25ec5ac3b380cedaef62","created_at":"2026-10-25T16:26:02.860Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ede01c19342ccbc813634345adaf99b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:02.905Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a95f25ec5ac3b380cedaef62: start","job_status":"start","queue_duration_s":0.002321,"scheduling_latency_s":0.002356}1506gitlab # [ 176.577077] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a95f25ec5ac3b380cedaef62","created_at":"2026-10-25T16:26:02.860Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ede01c19342ccbc813634345adaf99b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:02.905Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a95f25ec5ac3b380cedaef62: done: 0.165246 sec","job_status":"done","queue_duration_s":0.002321,"scheduling_latency_s":0.002356,"redis_calls":7,"redis_duration_s":0.023753000000000003,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.021864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.165246,"completed_at":"2026-10-25T16:26:03.072Z","load_balancing_strategy":"primary","db_duration_s":0.080663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 176.638192] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d4cfba6e20bc4d9d3259512f","created_at":"2026-10-25T16:26:02.950Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:02.953Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d4cfba6e20bc4d9d3259512f: start","job_status":"start","queue_duration_s":0.180272,"scheduling_latency_s":0.180318}1508gitlab # [ 176.906684] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"d4cfba6e20bc4d9d3259512f","created_at":"2026-10-25T16:26:02.950Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:02.953Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-d4cfba6e20bc4d9d3259512f: done: 0.268459 sec","job_status":"done","queue_duration_s":0.180272,"scheduling_latency_s":0.180318,"redis_calls":60,"redis_duration_s":0.08316,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.002268,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.07771,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003182,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.111613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.268459,"completed_at":"2026-10-25T16:26:03.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 176.947615] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.443Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"0dfac4c481ada719cb557b7a","created_at":"2026-10-25T16:26:02.983Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8eef72893127626a5dd71261bf402b0","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:02.996Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-0dfac4c481ada719cb557b7a: start","job_status":"start","queue_duration_s":0.446755,"scheduling_latency_s":0.446851}1510gitlab # [ 177.004724] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"0dfac4c481ada719cb557b7a","created_at":"2026-10-25T16:26:02.983Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8eef72893127626a5dd71261bf402b0","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:02.996Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-0dfac4c481ada719cb557b7a: done: 0.05704 sec","job_status":"done","queue_duration_s":0.446755,"scheduling_latency_s":0.446851,"redis_calls":12,"redis_duration_s":0.003039,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000578,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400609,"duration_s":0.05704,"completed_at":"2026-10-25T16:26:03.500Z","load_balancing_strategy":"primary","db_duration_s":0.000838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 177.044282] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"73369ec15a831fe3af509fc5","created_at":"2026-10-25T16:26:03.011Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e77da87a2985ceae00e620d55196fe13","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.013Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-73369ec15a831fe3af509fc5: start","job_status":"start","queue_duration_s":0.526144,"scheduling_latency_s":0.526183}1512gitlab # [ 177.070418] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"73369ec15a831fe3af509fc5","created_at":"2026-10-25T16:26:03.011Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e77da87a2985ceae00e620d55196fe13","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.013Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-73369ec15a831fe3af509fc5: done: 0.026111 sec","job_status":"done","queue_duration_s":0.526144,"scheduling_latency_s":0.526183,"redis_calls":9,"redis_duration_s":0.003272,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000820495,"exclusive_lock_hold_duration_s":0.004829385,"duration_s":0.026111,"completed_at":"2026-10-25T16:26:03.566Z","load_balancing_strategy":"primary","db_duration_s":0.001814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 177.107454] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9b1df4c9b3d7cfd885b08214","created_at":"2026-10-25T16:26:03.030Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.033Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9b1df4c9b3d7cfd885b08214: start","job_status":"start","queue_duration_s":0.569877,"scheduling_latency_s":0.569916}1514gitlab # [ 177.151856] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9b1df4c9b3d7cfd885b08214","created_at":"2026-10-25T16:26:03.030Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.033Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9b1df4c9b3d7cfd885b08214: done: 0.044327 sec","job_status":"done","queue_duration_s":0.569877,"scheduling_latency_s":0.569916,"redis_calls":14,"redis_duration_s":0.003101,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000387,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00202,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000694,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044327,"completed_at":"2026-10-25T16:26:03.647Z","load_balancing_strategy":"primary","db_duration_s":0.001045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 177.189391] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c9647b77543edab32c1ff4b7","created_at":"2026-10-25T16:26:03.037Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a00ef6822fd03a093947084e7e9da843","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T16:26:03.040Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c9647b77543edab32c1ff4b7: start","job_status":"start","queue_duration_s":0.645157,"scheduling_latency_s":0.64521}1516gitlab # [ 177.202521] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.697Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1517gitlab # [ 177.210727] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c9647b77543edab32c1ff4b7","created_at":"2026-10-25T16:26:03.037Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a00ef6822fd03a093947084e7e9da843","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T16:26:03.040Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c9647b77543edab32c1ff4b7: done: 0.021291 sec","job_status":"done","queue_duration_s":0.645157,"scheduling_latency_s":0.64521,"redis_calls":7,"redis_duration_s":0.002175,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021291,"completed_at":"2026-10-25T16:26:03.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 177.246981] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ef9ecc2d75aa59ee79c8d798","created_at":"2026-10-25T16:26:03.055Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e766ebb324512e2bc8517361fc4c6968","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.059Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ef9ecc2d75aa59ee79c8d798: start","job_status":"start","queue_duration_s":0.683236,"scheduling_latency_s":0.683274}1519gitlab # [ 177.269453] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.765Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1520gitlab # [ 177.279479] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ef9ecc2d75aa59ee79c8d798","created_at":"2026-10-25T16:26:03.055Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e766ebb324512e2bc8517361fc4c6968","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.059Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ef9ecc2d75aa59ee79c8d798: done: 0.03229 sec","job_status":"done","queue_duration_s":0.683236,"scheduling_latency_s":0.683274,"redis_calls":7,"redis_duration_s":0.00375,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03229,"completed_at":"2026-10-25T16:26:03.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 177.317752] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"346ab3bd3f176d8f3bee4085","created_at":"2026-10-25T16:26:03.071Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b6ab78c314bfa429e6276fc1dd66a70","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T16:26:03.132Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-346ab3bd3f176d8f3bee4085: start","job_status":"start","queue_duration_s":0.681023,"scheduling_latency_s":0.681063}1522gitlab # [ 177.329527] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.825Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1523gitlab # [ 177.337555] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"346ab3bd3f176d8f3bee4085","created_at":"2026-10-25T16:26:03.071Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b6ab78c314bfa429e6276fc1dd66a70","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T16:26:03.132Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-346ab3bd3f176d8f3bee4085: done: 0.019714 sec","job_status":"done","queue_duration_s":0.681023,"scheduling_latency_s":0.681063,"redis_calls":7,"redis_duration_s":0.002201,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000648,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019714,"completed_at":"2026-10-25T16:26:03.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 177.374217] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"eca9c5afba5d8f46fd7a8b72","created_at":"2026-10-25T16:26:03.140Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8f7a27cfd8fd0c49b12dbaa040d3d51","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.142Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-eca9c5afba5d8f46fd7a8b72: start","job_status":"start","queue_duration_s":0.727086,"scheduling_latency_s":0.727124}1525gitlab # [ 177.406053] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"eca9c5afba5d8f46fd7a8b72","created_at":"2026-10-25T16:26:03.140Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8f7a27cfd8fd0c49b12dbaa040d3d51","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.142Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-eca9c5afba5d8f46fd7a8b72: done: 0.031819 sec","job_status":"done","queue_duration_s":0.727086,"scheduling_latency_s":0.727124,"redis_calls":7,"redis_duration_s":0.001654,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031819,"completed_at":"2026-10-25T16:26:03.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 177.444183] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9ff1e607c71a4ed5cf1c7086","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c537af74ba442f82484f9de73b956ff","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.172Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9ff1e607c71a4ed5cf1c7086: start","job_status":"start","queue_duration_s":0.766589,"scheduling_latency_s":0.766628}1527gitlab # [ 177.483517] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:03.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9ff1e607c71a4ed5cf1c7086","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c537af74ba442f82484f9de73b956ff","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.172Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9ff1e607c71a4ed5cf1c7086: done: 0.04004 sec","job_status":"done","queue_duration_s":0.766589,"scheduling_latency_s":0.766628,"redis_calls":10,"redis_duration_s":0.002362,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006540216,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.04004,"completed_at":"2026-10-25T16:26:03.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003038,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1528gitlab # [ 177.522986] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2c79a7e4bc7f25e9d1071077","created_at":"2026-10-25T16:26:03.188Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb5a518ad060f8a036ac4f23a07fb1b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.198Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2c79a7e4bc7f25e9d1071077: start","job_status":"start","queue_duration_s":0.819916,"scheduling_latency_s":0.819954}1529gitlab # [ 177.566595] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2c79a7e4bc7f25e9d1071077","created_at":"2026-10-25T16:26:03.188Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eb5a518ad060f8a036ac4f23a07fb1b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.198Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2c79a7e4bc7f25e9d1071077: done: 0.043521 sec","job_status":"done","queue_duration_s":0.819916,"scheduling_latency_s":0.819954,"redis_calls":12,"redis_duration_s":0.002762,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000717969,"exclusive_lock_hold_duration_s":0.006390197,"duration_s":0.043521,"completed_at":"2026-10-25T16:26:04.062Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 177.587404] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"0fc8e4f73ca850007260d28e","created_at":"2026-10-25T16:26:03.209Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f580c426ae156ceb9b79a8b0480705da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.214Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-0fc8e4f73ca850007260d28e: start","job_status":"start","queue_duration_s":0.850863,"scheduling_latency_s":0.850894}1531gitlab # [ 177.588535] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.076Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1532gitlab # [ 177.589516] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"0fc8e4f73ca850007260d28e","created_at":"2026-10-25T16:26:03.209Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f580c426ae156ceb9b79a8b0480705da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.214Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-0fc8e4f73ca850007260d28e: done: 0.018549 sec","job_status":"done","queue_duration_s":0.850863,"scheduling_latency_s":0.850894,"redis_calls":7,"redis_duration_s":0.002193,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018549,"completed_at":"2026-10-25T16:26:04.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 177.659309] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5ac1b5a8e92e3673ed5bb961","created_at":"2026-10-25T16:26:03.233Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c679b753ef91e3d31df7639ad24a89","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.238Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5ac1b5a8e92e3673ed5bb961: start","job_status":"start","queue_duration_s":0.916704,"scheduling_latency_s":0.916749}1534gitlab # [ 177.694071] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"5ac1b5a8e92e3673ed5bb961","created_at":"2026-10-25T16:26:03.233Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c679b753ef91e3d31df7639ad24a89","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.238Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-5ac1b5a8e92e3673ed5bb961: done: 0.034673 sec","job_status":"done","queue_duration_s":0.916704,"scheduling_latency_s":0.916749,"redis_calls":9,"redis_duration_s":0.002161,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000732495,"exclusive_lock_hold_duration_s":0.004063087,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.034673,"completed_at":"2026-10-25T16:26:04.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 177.732726] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2c6cffbbb085b86ffc58172d","created_at":"2026-10-25T16:26:03.248Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d685f914c942df8e235ce8b77da2bb0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.253Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2c6cffbbb085b86ffc58172d: start","job_status":"start","queue_duration_s":0.975629,"scheduling_latency_s":0.975669}1536gitlab # [ 177.744522] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.240Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1537gitlab # [ 177.752397] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2c6cffbbb085b86ffc58172d","created_at":"2026-10-25T16:26:03.248Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d685f914c942df8e235ce8b77da2bb0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.253Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2c6cffbbb085b86ffc58172d: done: 0.019626 sec","job_status":"done","queue_duration_s":0.975629,"scheduling_latency_s":0.975669,"redis_calls":7,"redis_duration_s":0.002261,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019626,"completed_at":"2026-10-25T16:26:04.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 177.789962] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6761a70b51248b2ab6da4904","created_at":"2026-10-25T16:26:03.272Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6925479d40e64c51be7af1089f02152","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.276Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6761a70b51248b2ab6da4904: start","job_status":"start","queue_duration_s":1.009532,"scheduling_latency_s":1.009571}1539gitlab # [ 177.847430] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6761a70b51248b2ab6da4904","created_at":"2026-10-25T16:26:03.272Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6925479d40e64c51be7af1089f02152","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.276Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6761a70b51248b2ab6da4904: done: 0.057405 sec","job_status":"done","queue_duration_s":1.009532,"scheduling_latency_s":1.009571,"redis_calls":9,"redis_duration_s":0.002016,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007568,"exclusive_lock_hold_duration_s":0.013986135,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.057405,"completed_at":"2026-10-25T16:26:04.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 177.853150] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d87d3c0710bbb3bb445a5394","created_at":"2026-10-25T16:26:03.294Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70c2c44b393fe98b8746c838d269a39a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.298Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d87d3c0710bbb3bb445a5394: start","job_status":"start","queue_duration_s":1.048899,"scheduling_latency_s":1.048956}1541gitlab # [ 177.893690] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d87d3c0710bbb3bb445a5394","created_at":"2026-10-25T16:26:03.294Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70c2c44b393fe98b8746c838d269a39a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.298Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d87d3c0710bbb3bb445a5394: done: 0.022845 sec","job_status":"done","queue_duration_s":1.048899,"scheduling_latency_s":1.048956,"redis_calls":7,"redis_duration_s":0.001991,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022845,"completed_at":"2026-10-25T16:26:04.370Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 177.895165] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d05bafe6874627349d8a091d","created_at":"2026-10-25T16:26:03.306Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bbc9d57d4286dbf7df129b4170e0063","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.319Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d05bafe6874627349d8a091d: start","job_status":"start","queue_duration_s":1.051934,"scheduling_latency_s":1.051958}1543gitlab # [ 177.907880] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d05bafe6874627349d8a091d","created_at":"2026-10-25T16:26:03.306Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bbc9d57d4286dbf7df129b4170e0063","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.319Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d05bafe6874627349d8a091d: done: 0.022058 sec","job_status":"done","queue_duration_s":1.051934,"scheduling_latency_s":1.051958,"redis_calls":10,"redis_duration_s":0.001845,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00020701,"duration_s":0.022058,"completed_at":"2026-10-25T16:26:04.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 177.957614] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a67aacd8307283530e682a36","created_at":"2026-10-25T16:26:03.330Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78a209795ad4af1e0b48f90ab58d414b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.333Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a67aacd8307283530e682a36: start","job_status":"start","queue_duration_s":1.060891,"scheduling_latency_s":1.060904}1545gitlab # [ 178.021312] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a67aacd8307283530e682a36","created_at":"2026-10-25T16:26:03.330Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78a209795ad4af1e0b48f90ab58d414b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.333Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a67aacd8307283530e682a36: done: 0.122295 sec","job_status":"done","queue_duration_s":1.060891,"scheduling_latency_s":1.060904,"redis_calls":11,"redis_duration_s":0.001963,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00082,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000344178,"exclusive_lock_hold_duration_s":0.108071557,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.122295,"completed_at":"2026-10-25T16:26:04.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 178.060893] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d16a96189bb0496a5e07efaf","created_at":"2026-10-25T16:26:03.354Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"250b59bd542b5327e8febff0a66ed69f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.356Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d16a96189bb0496a5e07efaf: start","job_status":"start","queue_duration_s":1.200182,"scheduling_latency_s":1.200204}1547gitlab # [ 178.120915] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d16a96189bb0496a5e07efaf","created_at":"2026-10-25T16:26:03.354Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"250b59bd542b5327e8febff0a66ed69f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.356Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d16a96189bb0496a5e07efaf: done: 0.059502 sec","job_status":"done","queue_duration_s":1.200182,"scheduling_latency_s":1.200204,"redis_calls":9,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000498387,"exclusive_lock_hold_duration_s":0.044327981,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.059502,"completed_at":"2026-10-25T16:26:04.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 178.165294] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0557d795228e5225b1edc32a","created_at":"2026-10-25T16:26:03.372Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab0a2732c483233bc59c36eaf848dd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.375Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0557d795228e5225b1edc32a: start","job_status":"start","queue_duration_s":1.285647,"scheduling_latency_s":1.285689}1549gitlab # [ 178.196560] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0557d795228e5225b1edc32a","created_at":"2026-10-25T16:26:03.372Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab0a2732c483233bc59c36eaf848dd0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.375Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0557d795228e5225b1edc32a: done: 0.031222 sec","job_status":"done","queue_duration_s":1.285647,"scheduling_latency_s":1.285689,"redis_calls":7,"redis_duration_s":0.0018640000000000002,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031222,"completed_at":"2026-10-25T16:26:04.692Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 178.234824] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:04.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"046c02181847ec459e9b1fd5","created_at":"2026-10-25T16:26:03.383Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fb29c79fe05312aa2f4b735c20bc4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.386Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-046c02181847ec459e9b1fd5: start","job_status":"start","queue_duration_s":1.344471,"scheduling_latency_s":1.34451}1551gitlab # [ 178.530183] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"046c02181847ec459e9b1fd5","created_at":"2026-10-25T16:26:03.383Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3fb29c79fe05312aa2f4b735c20bc4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.386Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-046c02181847ec459e9b1fd5: done: 0.294938 sec","job_status":"done","queue_duration_s":1.344471,"scheduling_latency_s":1.34451,"redis_calls":562,"redis_duration_s":0.101005,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.099657,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.217505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.294938,"completed_at":"2026-10-25T16:26:05.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 178.615366] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e88af40ea23c99e47c85147","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e88af40ea23c99e47c85147: start","job_status":"start","queue_duration_s":1.720868,"scheduling_latency_s":1.720917}1553gitlab # [ 178.640386] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e88af40ea23c99e47c85147","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e88af40ea23c99e47c85147: done: 0.025235 sec","job_status":"done","queue_duration_s":1.720868,"scheduling_latency_s":1.720917,"redis_calls":13,"redis_duration_s":0.003656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002483,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025235,"completed_at":"2026-10-25T16:26:05.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 178.677272] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16f6e2691942f3a969390472","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16f6e2691942f3a969390472: start","job_status":"start","queue_duration_s":1.782837,"scheduling_latency_s":1.782878}1555gitlab # [ 178.701487] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16f6e2691942f3a969390472","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16f6e2691942f3a969390472: done: 0.023578 sec","job_status":"done","queue_duration_s":1.782837,"scheduling_latency_s":1.782878,"redis_calls":13,"redis_duration_s":0.0036090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023578,"completed_at":"2026-10-25T16:26:05.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 178.737755] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55175e7899e4d022bbc45803","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55175e7899e4d022bbc45803: start","job_status":"start","queue_duration_s":1.843337,"scheduling_latency_s":1.843374}1557gitlab # [ 178.769595] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55175e7899e4d022bbc45803","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55175e7899e4d022bbc45803: done: 0.031775 sec","job_status":"done","queue_duration_s":1.843337,"scheduling_latency_s":1.843374,"redis_calls":13,"redis_duration_s":0.0026899999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031775,"completed_at":"2026-10-25T16:26:05.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 178.805934] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17f2c7462ff9b0f39bc59f02","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17f2c7462ff9b0f39bc59f02: start","job_status":"start","queue_duration_s":1.911507,"scheduling_latency_s":1.911546}1559gitlab # [ 178.830498] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17f2c7462ff9b0f39bc59f02","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17f2c7462ff9b0f39bc59f02: done: 0.024553 sec","job_status":"done","queue_duration_s":1.911507,"scheduling_latency_s":1.911546,"redis_calls":13,"redis_duration_s":0.003688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002485,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024553,"completed_at":"2026-10-25T16:26:05.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 178.866677] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f904f67203ad8ecb4fce7275","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f904f67203ad8ecb4fce7275: start","job_status":"start","queue_duration_s":1.972283,"scheduling_latency_s":1.97232}1561gitlab # [ 178.898858] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f904f67203ad8ecb4fce7275","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f904f67203ad8ecb4fce7275: done: 0.03208 sec","job_status":"done","queue_duration_s":1.972283,"scheduling_latency_s":1.97232,"redis_calls":13,"redis_duration_s":0.0025830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03208,"completed_at":"2026-10-25T16:26:05.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 178.935321] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ead77f2c0f3f02d14b63e84a","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ead77f2c0f3f02d14b63e84a: start","job_status":"start","queue_duration_s":2.040929,"scheduling_latency_s":2.040967}1563gitlab # [ 178.959612] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ead77f2c0f3f02d14b63e84a","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ead77f2c0f3f02d14b63e84a: done: 0.024266 sec","job_status":"done","queue_duration_s":2.040929,"scheduling_latency_s":2.040967,"redis_calls":13,"redis_duration_s":0.0037079999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002498,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024266,"completed_at":"2026-10-25T16:26:05.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 178.996101] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da35ff3da1fe80d4875d02ff","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da35ff3da1fe80d4875d02ff: start","job_status":"start","queue_duration_s":2.101599,"scheduling_latency_s":2.101638}1565gitlab # [ 179.018713] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da35ff3da1fe80d4875d02ff","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da35ff3da1fe80d4875d02ff: done: 0.022448 sec","job_status":"done","queue_duration_s":2.101599,"scheduling_latency_s":2.101638,"redis_calls":13,"redis_duration_s":0.002788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022448,"completed_at":"2026-10-25T16:26:05.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 179.054107] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d95e306e8f04bb7282ea201","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d95e306e8f04bb7282ea201: start","job_status":"start","queue_duration_s":2.159902,"scheduling_latency_s":2.159923}1567gitlab # [ 179.065480] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d95e306e8f04bb7282ea201","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d95e306e8f04bb7282ea201: done: 0.011145 sec","job_status":"done","queue_duration_s":2.159902,"scheduling_latency_s":2.159923,"redis_calls":13,"redis_duration_s":0.001992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011145,"completed_at":"2026-10-25T16:26:05.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 179.066261] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d75a1bba129fb9dfbebbabb","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d75a1bba129fb9dfbebbabb: start","job_status":"start","queue_duration_s":2.171906,"scheduling_latency_s":2.171918}1569gitlab # [ 179.075435] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d75a1bba129fb9dfbebbabb","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d75a1bba129fb9dfbebbabb: done: 0.00951 sec","job_status":"done","queue_duration_s":2.171906,"scheduling_latency_s":2.171918,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00951,"completed_at":"2026-10-25T16:26:05.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 179.117670] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27102050bfbb6ee16a51e0d","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27102050bfbb6ee16a51e0d: start","job_status":"start","queue_duration_s":2.182247,"scheduling_latency_s":2.18226}1571gitlab # [ 179.118507] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e27102050bfbb6ee16a51e0d","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e27102050bfbb6ee16a51e0d: done: 0.008984 sec","job_status":"done","queue_duration_s":2.182247,"scheduling_latency_s":2.18226,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008984,"completed_at":"2026-10-25T16:26:05.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 179.183110] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4f62dc0c9a88bb7e0048295","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4f62dc0c9a88bb7e0048295: start","job_status":"start","queue_duration_s":2.191965,"scheduling_latency_s":2.191977}1573gitlab # [ 179.183760] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4f62dc0c9a88bb7e0048295","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4f62dc0c9a88bb7e0048295: done: 0.010527 sec","job_status":"done","queue_duration_s":2.191965,"scheduling_latency_s":2.191977,"redis_calls":13,"redis_duration_s":0.003362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010527,"completed_at":"2026-10-25T16:26:05.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 179.222084] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f9117fae36c4be36b5fbcc4","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f9117fae36c4be36b5fbcc4: start","job_status":"start","queue_duration_s":2.203266,"scheduling_latency_s":2.203279}1575gitlab # [ 179.222755] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f9117fae36c4be36b5fbcc4","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f9117fae36c4be36b5fbcc4: done: 0.008785 sec","job_status":"done","queue_duration_s":2.203266,"scheduling_latency_s":2.203279,"redis_calls":13,"redis_duration_s":0.001376,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008785,"completed_at":"2026-10-25T16:26:05.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 179.261566] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13d94a8798e3b298f5c7b9c2","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13d94a8798e3b298f5c7b9c2: start","job_status":"start","queue_duration_s":2.213168,"scheduling_latency_s":2.213181}1577gitlab # [ 179.262492] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13d94a8798e3b298f5c7b9c2","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13d94a8798e3b298f5c7b9c2: done: 0.00902 sec","job_status":"done","queue_duration_s":2.213168,"scheduling_latency_s":2.213181,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00902,"completed_at":"2026-10-25T16:26:05.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 179.305883] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b65eea360669b4a1145c3166","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b65eea360669b4a1145c3166: start","job_status":"start","queue_duration_s":2.222993,"scheduling_latency_s":2.223005}1579gitlab # [ 179.306777] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b65eea360669b4a1145c3166","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b65eea360669b4a1145c3166: done: 0.009021 sec","job_status":"done","queue_duration_s":2.222993,"scheduling_latency_s":2.223005,"redis_calls":13,"redis_duration_s":0.001828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009021,"completed_at":"2026-10-25T16:26:05.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 179.348893] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc33aed0eb11d46484bcac1","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc33aed0eb11d46484bcac1: start","job_status":"start","queue_duration_s":2.232813,"scheduling_latency_s":2.232826}1581gitlab # [ 179.349881] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc33aed0eb11d46484bcac1","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc33aed0eb11d46484bcac1: done: 0.009031 sec","job_status":"done","queue_duration_s":2.232813,"scheduling_latency_s":2.232826,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009031,"completed_at":"2026-10-25T16:26:05.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 179.390248] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23a42271aebc01a8e3a58933","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23a42271aebc01a8e3a58933: start","job_status":"start","queue_duration_s":2.243006,"scheduling_latency_s":2.243018}1583gitlab # [ 179.391045] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23a42271aebc01a8e3a58933","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23a42271aebc01a8e3a58933: done: 0.009179 sec","job_status":"done","queue_duration_s":2.243006,"scheduling_latency_s":2.243018,"redis_calls":13,"redis_duration_s":0.0014609999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009179,"completed_at":"2026-10-25T16:26:05.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 179.443745] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec05b2dfa136dd8f1ae4ad1b","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec05b2dfa136dd8f1ae4ad1b: start","job_status":"start","queue_duration_s":2.252981,"scheduling_latency_s":2.252993}1585gitlab # [ 179.444556] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec05b2dfa136dd8f1ae4ad1b","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec05b2dfa136dd8f1ae4ad1b: done: 0.009569 sec","job_status":"done","queue_duration_s":2.252981,"scheduling_latency_s":2.252993,"redis_calls":13,"redis_duration_s":0.001365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009569,"completed_at":"2026-10-25T16:26:05.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 179.499689] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8350bdc91bba56acdea59b17","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8350bdc91bba56acdea59b17: start","job_status":"start","queue_duration_s":2.263327,"scheduling_latency_s":2.263339}1587gitlab # [ 179.500559] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8350bdc91bba56acdea59b17","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8350bdc91bba56acdea59b17: done: 0.008781 sec","job_status":"done","queue_duration_s":2.263327,"scheduling_latency_s":2.263339,"redis_calls":13,"redis_duration_s":0.001319,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000431,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008781,"completed_at":"2026-10-25T16:26:05.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 179.510024] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24b9ed330dde727baeea8b84","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24b9ed330dde727baeea8b84: start","job_status":"start","queue_duration_s":2.272877,"scheduling_latency_s":2.27289}1589gitlab # [ 179.549409] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24b9ed330dde727baeea8b84","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24b9ed330dde727baeea8b84: done: 0.009399 sec","job_status":"done","queue_duration_s":2.272877,"scheduling_latency_s":2.27289,"redis_calls":13,"redis_duration_s":0.001333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000426,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009399,"completed_at":"2026-10-25T16:26:05.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 179.554538] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4789066282083717dc6470c5","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4789066282083717dc6470c5: start","job_status":"start","queue_duration_s":2.283024,"scheduling_latency_s":2.283045}1591gitlab # [ 179.565881] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4789066282083717dc6470c5","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4789066282083717dc6470c5: done: 0.009259 sec","job_status":"done","queue_duration_s":2.283024,"scheduling_latency_s":2.283045,"redis_calls":13,"redis_duration_s":0.0018540000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009259,"completed_at":"2026-10-25T16:26:05.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 179.605451] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba347cecfbe8817f286656c8","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba347cecfbe8817f286656c8: start","job_status":"start","queue_duration_s":2.29304,"scheduling_latency_s":2.293053}1593gitlab # [ 179.610563] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba347cecfbe8817f286656c8","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba347cecfbe8817f286656c8: done: 0.00887 sec","job_status":"done","queue_duration_s":2.29304,"scheduling_latency_s":2.293053,"redis_calls":13,"redis_duration_s":0.00182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00887,"completed_at":"2026-10-25T16:26:05.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 179.649600] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04205638a2c1928b0c890243","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04205638a2c1928b0c890243: start","job_status":"start","queue_duration_s":2.302682,"scheduling_latency_s":2.302694}1595gitlab # [ 179.654819] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04205638a2c1928b0c890243","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04205638a2c1928b0c890243: done: 0.008712 sec","job_status":"done","queue_duration_s":2.302682,"scheduling_latency_s":2.302694,"redis_calls":13,"redis_duration_s":0.001346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008712,"completed_at":"2026-10-25T16:26:05.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 179.696670] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07aebdafed45838155ddcdcf","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07aebdafed45838155ddcdcf: start","job_status":"start","queue_duration_s":2.312505,"scheduling_latency_s":2.312518}1597gitlab # [ 179.736735] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07aebdafed45838155ddcdcf","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07aebdafed45838155ddcdcf: done: 0.008729 sec","job_status":"done","queue_duration_s":2.312505,"scheduling_latency_s":2.312518,"redis_calls":13,"redis_duration_s":0.001352,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000435,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008729,"completed_at":"2026-10-25T16:26:05.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 179.737856] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ffa0edc5b2cb088525bf2fa","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ffa0edc5b2cb088525bf2fa: start","job_status":"start","queue_duration_s":2.322013,"scheduling_latency_s":2.322025}1599gitlab # [ 179.744695] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ffa0edc5b2cb088525bf2fa","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ffa0edc5b2cb088525bf2fa: done: 0.009768 sec","job_status":"done","queue_duration_s":2.322013,"scheduling_latency_s":2.322025,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009768,"completed_at":"2026-10-25T16:26:05.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 179.804816] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dac7ffb5f034785ae385892","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dac7ffb5f034785ae385892: start","job_status":"start","queue_duration_s":2.332561,"scheduling_latency_s":2.332573}1601gitlab # [ 179.805634] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dac7ffb5f034785ae385892","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dac7ffb5f034785ae385892: done: 0.009016 sec","job_status":"done","queue_duration_s":2.332561,"scheduling_latency_s":2.332573,"redis_calls":13,"redis_duration_s":0.001369,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009016,"completed_at":"2026-10-25T16:26:05.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 179.848839] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7385db9bee4b93286f7d054","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7385db9bee4b93286f7d054: start","job_status":"start","queue_duration_s":2.342341,"scheduling_latency_s":2.342352}1603gitlab # [ 179.849612] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7385db9bee4b93286f7d054","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7385db9bee4b93286f7d054: done: 0.009 sec","job_status":"done","queue_duration_s":2.342341,"scheduling_latency_s":2.342352,"redis_calls":13,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009,"completed_at":"2026-10-25T16:26:05.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 179.893830] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d149a22ebe22088fc3401d0a","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d149a22ebe22088fc3401d0a: start","job_status":"start","queue_duration_s":2.352095,"scheduling_latency_s":2.352108}1605gitlab # [ 179.894623] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d149a22ebe22088fc3401d0a","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d149a22ebe22088fc3401d0a: done: 0.009031 sec","job_status":"done","queue_duration_s":2.352095,"scheduling_latency_s":2.352108,"redis_calls":13,"redis_duration_s":0.001356,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009031,"completed_at":"2026-10-25T16:26:05.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 179.912131] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b4af443be04f8dc299d5198","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b4af443be04f8dc299d5198: start","job_status":"start","queue_duration_s":2.362143,"scheduling_latency_s":2.362155}1607gitlab # [ 179.949790] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b4af443be04f8dc299d5198","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b4af443be04f8dc299d5198: done: 0.008719 sec","job_status":"done","queue_duration_s":2.362143,"scheduling_latency_s":2.362155,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008719,"completed_at":"2026-10-25T16:26:05.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 179.956410] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df9fd1b2a4dbbcffbf6faa73","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df9fd1b2a4dbbcffbf6faa73: start","job_status":"start","queue_duration_s":2.371683,"scheduling_latency_s":2.371696}1609gitlab # [ 180.000616] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df9fd1b2a4dbbcffbf6faa73","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df9fd1b2a4dbbcffbf6faa73: done: 0.008867 sec","job_status":"done","queue_duration_s":2.371683,"scheduling_latency_s":2.371696,"redis_calls":13,"redis_duration_s":0.001372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008867,"completed_at":"2026-10-25T16:26:05.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 180.001641] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34228d2b643c28609bedac97","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34228d2b643c28609bedac97: start","job_status":"start","queue_duration_s":2.381334,"scheduling_latency_s":2.381347}1611gitlab # [ 180.011152] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34228d2b643c28609bedac97","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34228d2b643c28609bedac97: done: 0.008601 sec","job_status":"done","queue_duration_s":2.381334,"scheduling_latency_s":2.381347,"redis_calls":13,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000427,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008601,"completed_at":"2026-10-25T16:26:05.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 180.050828] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"990e428fdf08f759e88102a9","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-990e428fdf08f759e88102a9: start","job_status":"start","queue_duration_s":2.391079,"scheduling_latency_s":2.391092}1613gitlab # [ 180.091196] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"990e428fdf08f759e88102a9","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-990e428fdf08f759e88102a9: done: 0.009603 sec","job_status":"done","queue_duration_s":2.391079,"scheduling_latency_s":2.391092,"redis_calls":13,"redis_duration_s":0.002186,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001474,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009603,"completed_at":"2026-10-25T16:26:05.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 180.091668] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c55ef17cd199e7a6f5417b0","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c55ef17cd199e7a6f5417b0: start","job_status":"start","queue_duration_s":2.40189,"scheduling_latency_s":2.401903}1615gitlab # [ 180.100635] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c55ef17cd199e7a6f5417b0","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c55ef17cd199e7a6f5417b0: done: 0.009346 sec","job_status":"done","queue_duration_s":2.40189,"scheduling_latency_s":2.401903,"redis_calls":13,"redis_duration_s":0.0021980000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001523,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009346,"completed_at":"2026-10-25T16:26:05.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 180.138772] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4e0eeeccb2d8f2daa3dd20","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4e0eeeccb2d8f2daa3dd20: start","job_status":"start","queue_duration_s":2.412052,"scheduling_latency_s":2.412065}1617gitlab # [ 180.176829] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4e0eeeccb2d8f2daa3dd20","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4e0eeeccb2d8f2daa3dd20: done: 0.009316 sec","job_status":"done","queue_duration_s":2.412052,"scheduling_latency_s":2.412065,"redis_calls":13,"redis_duration_s":0.00191,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009316,"completed_at":"2026-10-25T16:26:05.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618gitlab # [ 180.178252] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d18d7c7d01eba06e08896c9","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d18d7c7d01eba06e08896c9: start","job_status":"start","queue_duration_s":2.422286,"scheduling_latency_s":2.422298}1619gitlab # [ 180.219188] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d18d7c7d01eba06e08896c9","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d18d7c7d01eba06e08896c9: done: 0.009511 sec","job_status":"done","queue_duration_s":2.422286,"scheduling_latency_s":2.422298,"redis_calls":13,"redis_duration_s":0.00215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009511,"completed_at":"2026-10-25T16:26:05.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 180.223490] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"325d731be63f1b07e1a48b34","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-325d731be63f1b07e1a48b34: start","job_status":"start","queue_duration_s":2.432923,"scheduling_latency_s":2.432935}1621gitlab # [ 180.269526] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"325d731be63f1b07e1a48b34","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-325d731be63f1b07e1a48b34: done: 0.009386 sec","job_status":"done","queue_duration_s":2.432923,"scheduling_latency_s":2.432935,"redis_calls":13,"redis_duration_s":0.001996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009386,"completed_at":"2026-10-25T16:26:05.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 180.270604] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5026bc343d4eeaf157ac2891","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5026bc343d4eeaf157ac2891: start","job_status":"start","queue_duration_s":2.443211,"scheduling_latency_s":2.443245}1623gitlab # [ 180.277880] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5026bc343d4eeaf157ac2891","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5026bc343d4eeaf157ac2891: done: 0.009725 sec","job_status":"done","queue_duration_s":2.443211,"scheduling_latency_s":2.443245,"redis_calls":13,"redis_duration_s":0.002031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001383,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009725,"completed_at":"2026-10-25T16:26:05.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 180.323565] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6504afd1da4e929680def80","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6504afd1da4e929680def80: start","job_status":"start","queue_duration_s":2.453882,"scheduling_latency_s":2.453894}1625gitlab # [ 180.324470] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6504afd1da4e929680def80","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6504afd1da4e929680def80: done: 0.009277 sec","job_status":"done","queue_duration_s":2.453882,"scheduling_latency_s":2.453894,"redis_calls":13,"redis_duration_s":0.0019460000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001378,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009277,"completed_at":"2026-10-25T16:26:05.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 180.362702] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"633535c0f12ffc1a1137b93b","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-633535c0f12ffc1a1137b93b: start","job_status":"start","queue_duration_s":2.464163,"scheduling_latency_s":2.464175}1627gitlab # [ 180.364962] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"633535c0f12ffc1a1137b93b","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-633535c0f12ffc1a1137b93b: done: 0.009334 sec","job_status":"done","queue_duration_s":2.464163,"scheduling_latency_s":2.464175,"redis_calls":13,"redis_duration_s":0.002019,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009334,"completed_at":"2026-10-25T16:26:05.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 180.412674] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aab8845a6b305b6c4265ae4d","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aab8845a6b305b6c4265ae4d: start","job_status":"start","queue_duration_s":2.474455,"scheduling_latency_s":2.474467}1629gitlab # [ 180.413514] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aab8845a6b305b6c4265ae4d","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aab8845a6b305b6c4265ae4d: done: 0.009377 sec","job_status":"done","queue_duration_s":2.474455,"scheduling_latency_s":2.474467,"redis_calls":13,"redis_duration_s":0.002115,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001485,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009377,"completed_at":"2026-10-25T16:26:05.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 180.455574] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0bfceedd280b54b9aeec373","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0bfceedd280b54b9aeec373: start","job_status":"start","queue_duration_s":2.484784,"scheduling_latency_s":2.484796}1631gitlab # [ 180.456493] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0bfceedd280b54b9aeec373","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0bfceedd280b54b9aeec373: done: 0.009453 sec","job_status":"done","queue_duration_s":2.484784,"scheduling_latency_s":2.484796,"redis_calls":13,"redis_duration_s":0.002168,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001501,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009453,"completed_at":"2026-10-25T16:26:05.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 180.494855] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b7561379912ed278740a613","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b7561379912ed278740a613: start","job_status":"start","queue_duration_s":2.495192,"scheduling_latency_s":2.495205}1633gitlab # [ 180.496784] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b7561379912ed278740a613","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b7561379912ed278740a613: done: 0.019817 sec","job_status":"done","queue_duration_s":2.495192,"scheduling_latency_s":2.495205,"redis_calls":13,"redis_duration_s":0.009005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007491,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019817,"completed_at":"2026-10-25T16:26:05.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 180.542533] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"480685874547c4bb2c210aad","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-480685874547c4bb2c210aad: start","job_status":"start","queue_duration_s":2.51583,"scheduling_latency_s":2.515843}1635gitlab # [ 180.543140] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"480685874547c4bb2c210aad","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-480685874547c4bb2c210aad: done: 0.008721 sec","job_status":"done","queue_duration_s":2.51583,"scheduling_latency_s":2.515843,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008721,"completed_at":"2026-10-25T16:26:05.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 180.596387] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78babd226ee9756eb10426bd","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78babd226ee9756eb10426bd: start","job_status":"start","queue_duration_s":2.525327,"scheduling_latency_s":2.525339}1637gitlab # [ 180.597932] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78babd226ee9756eb10426bd","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78babd226ee9756eb10426bd: done: 0.008541 sec","job_status":"done","queue_duration_s":2.525327,"scheduling_latency_s":2.525339,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008541,"completed_at":"2026-10-25T16:26:05.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 180.648490] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6700542ad6af53de5ae7ed","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6700542ad6af53de5ae7ed: start","job_status":"start","queue_duration_s":2.534646,"scheduling_latency_s":2.534658}1639gitlab # [ 180.649190] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b6700542ad6af53de5ae7ed","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b6700542ad6af53de5ae7ed: done: 0.008785 sec","job_status":"done","queue_duration_s":2.534646,"scheduling_latency_s":2.534658,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008785,"completed_at":"2026-10-25T16:26:05.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 180.661737] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13f1f2a0fcde3e9e55631df7","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13f1f2a0fcde3e9e55631df7: start","job_status":"start","queue_duration_s":2.544385,"scheduling_latency_s":2.544398}1641gitlab # [ 180.705453] postgres[2416]: [2416] ERROR: relation "table_without_models" does not exist1642gitlab # [ 180.706108] postgres[2416]: [2416] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1643gitlab # [ 180.706563] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13f1f2a0fcde3e9e55631df7","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13f1f2a0fcde3e9e55631df7: done: 0.008768 sec","job_status":"done","queue_duration_s":2.544385,"scheduling_latency_s":2.544398,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008768,"completed_at":"2026-10-25T16:26:05.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 180.707568] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8020ce6f88f341aafbddcedf","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8020ce6f88f341aafbddcedf: start","job_status":"start","queue_duration_s":2.553997,"scheduling_latency_s":2.55401}1645gitlab # [ 180.746227] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8020ce6f88f341aafbddcedf","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8020ce6f88f341aafbddcedf: done: 0.009821 sec","job_status":"done","queue_duration_s":2.553997,"scheduling_latency_s":2.55401,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009821,"completed_at":"2026-10-25T16:26:05.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 180.750509] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09e1866295e44a6824ba1177","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09e1866295e44a6824ba1177: start","job_status":"start","queue_duration_s":2.566971,"scheduling_latency_s":2.566993}1647gitlab # [ 180.796544] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09e1866295e44a6824ba1177","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09e1866295e44a6824ba1177: done: 0.010344 sec","job_status":"done","queue_duration_s":2.566971,"scheduling_latency_s":2.566993,"redis_calls":13,"redis_duration_s":0.001803,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010344,"completed_at":"2026-10-25T16:26:05.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 180.797659] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b56a7d9fc399bb37ef328d81","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b56a7d9fc399bb37ef328d81: start","job_status":"start","queue_duration_s":2.578357,"scheduling_latency_s":2.578371}1649gitlab # [ 180.804688] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b56a7d9fc399bb37ef328d81","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b56a7d9fc399bb37ef328d81: done: 0.009598 sec","job_status":"done","queue_duration_s":2.578357,"scheduling_latency_s":2.578371,"redis_calls":13,"redis_duration_s":0.001674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009598,"completed_at":"2026-10-25T16:26:05.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 180.868172] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c381f72c64479fbb874de7c0","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c381f72c64479fbb874de7c0: start","job_status":"start","queue_duration_s":2.588871,"scheduling_latency_s":2.588885}1651gitlab # [ 180.868847] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c381f72c64479fbb874de7c0","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c381f72c64479fbb874de7c0: done: 0.009691 sec","job_status":"done","queue_duration_s":2.588871,"scheduling_latency_s":2.588885,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009691,"completed_at":"2026-10-25T16:26:05.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 180.881896] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:05.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4dc2d69f503aec0ea25e807","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4dc2d69f503aec0ea25e807: start","job_status":"start","queue_duration_s":2.599465,"scheduling_latency_s":2.599478}1653gitlab # [ 180.928596] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4dc2d69f503aec0ea25e807","created_at":"2026-10-25T16:26:03.157Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-f11ae02e04fe48aa","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"6a2e4c57832135647e1f69c0b77a1f35","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.390Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4dc2d69f503aec0ea25e807: done: 0.010551 sec","job_status":"done","queue_duration_s":2.599465,"scheduling_latency_s":2.599478,"redis_calls":13,"redis_duration_s":0.0018149999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010551,"completed_at":"2026-10-25T16:26:06.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 180.929576] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3e1f4059b4407350edaf26bf","created_at":"2026-10-25T16:26:03.395Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b01550760cdaa1679f839c1479c6dfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.397Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3e1f4059b4407350edaf26bf: start","job_status":"start","queue_duration_s":2.603454,"scheduling_latency_s":2.603466}1655gitlab # [ 180.938553] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.005Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1656gitlab # [ 180.941467] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3e1f4059b4407350edaf26bf","created_at":"2026-10-25T16:26:03.395Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b01550760cdaa1679f839c1479c6dfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.397Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3e1f4059b4407350edaf26bf: done: 0.007445 sec","job_status":"done","queue_duration_s":2.603454,"scheduling_latency_s":2.603466,"redis_calls":7,"redis_duration_s":0.0008500000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007445,"completed_at":"2026-10-25T16:26:06.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 180.981061] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"448cb7842c27038751a56049","created_at":"2026-10-25T16:26:03.442Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"016fa762a5ebbafbe868d93d3777e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-25T16:26:03.457Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-448cb7842c27038751a56049: start","job_status":"start","queue_duration_s":2.552282,"scheduling_latency_s":2.552294}1658gitlab # [ 180.986970] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"448cb7842c27038751a56049","created_at":"2026-10-25T16:26:03.442Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"016fa762a5ebbafbe868d93d3777e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-25T16:26:03.457Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-448cb7842c27038751a56049: done: 0.013024 sec","job_status":"done","queue_duration_s":2.552282,"scheduling_latency_s":2.552294,"redis_calls":7,"redis_duration_s":0.000905,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013024,"completed_at":"2026-10-25T16:26:06.022Z","load_balancing_strategy":"primary","db_duration_s":0.001157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 181.020561] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"678e4e3e42d5f1efdf8bc93f","created_at":"2026-10-25T16:26:03.462Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"643093b8e6d47a4a84c0e9cb863a7552","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.465Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-678e4e3e42d5f1efdf8bc93f: start","job_status":"start","queue_duration_s":2.557452,"scheduling_latency_s":2.557466}1660gitlab # [ 181.057864] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.035Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"678e4e3e42d5f1efdf8bc93f","created_at":"2026-10-25T16:26:03.462Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-088b7b2f7b894a94","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"643093b8e6d47a4a84c0e9cb863a7552","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.465Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-678e4e3e42d5f1efdf8bc93f: done: 0.012102 sec","job_status":"done","queue_duration_s":2.557452,"scheduling_latency_s":2.557466,"redis_calls":7,"redis_duration_s":0.000931,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012102,"completed_at":"2026-10-25T16:26:06.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 181.095123] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.036Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"213db14b68897a076af8300b","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-213db14b68897a076af8300b: start","job_status":"start","queue_duration_s":2.396208,"scheduling_latency_s":2.396222}1662gitlab # [ 181.095771] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.043Z","message":"No existing merge request to be cleaned up."}1663gitlab # [ 181.096434] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.049Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"213db14b68897a076af8300b","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-213db14b68897a076af8300b: done: 0.013369 sec","job_status":"done","queue_duration_s":2.396208,"scheduling_latency_s":2.396222,"redis_calls":10,"redis_duration_s":0.001439,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013369,"completed_at":"2026-10-25T16:26:06.049Z","load_balancing_strategy":"primary","db_duration_s":0.001193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 181.134507] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.050Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ca3aa5b7116a0cd3c50615fb","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ca3aa5b7116a0cd3c50615fb: start","job_status":"start","queue_duration_s":2.41056,"scheduling_latency_s":2.410578}1665gitlab # [ 181.135205] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.057Z","message":"No existing merge request to be cleaned up."}1666gitlab # [ 181.135666] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.061Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ca3aa5b7116a0cd3c50615fb","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ca3aa5b7116a0cd3c50615fb: done: 0.011116 sec","job_status":"done","queue_duration_s":2.41056,"scheduling_latency_s":2.410578,"redis_calls":10,"redis_duration_s":0.0012850000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011116,"completed_at":"2026-10-25T16:26:06.061Z","load_balancing_strategy":"primary","db_duration_s":0.001062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 181.156583] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.062Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03754ac9ce556cdefe0aaeae","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03754ac9ce556cdefe0aaeae: start","job_status":"start","queue_duration_s":2.4225,"scheduling_latency_s":2.422513}1668gitlab # [ 181.167398] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.069Z","message":"No existing merge request to be cleaned up."}1669gitlab # [ 181.168610] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.073Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03754ac9ce556cdefe0aaeae","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03754ac9ce556cdefe0aaeae: done: 0.010955 sec","job_status":"done","queue_duration_s":2.4225,"scheduling_latency_s":2.422513,"redis_calls":10,"redis_duration_s":0.001397,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010955,"completed_at":"2026-10-25T16:26:06.073Z","load_balancing_strategy":"primary","db_duration_s":0.001243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 181.213648] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.074Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f3b35e6fa22d588953df18ab","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f3b35e6fa22d588953df18ab: start","job_status":"start","queue_duration_s":2.434235,"scheduling_latency_s":2.434248}1671gitlab # [ 181.214472] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.081Z","message":"No existing merge request to be cleaned up."}1672gitlab # [ 181.215024] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:06.087Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f3b35e6fa22d588953df18ab","created_at":"2026-10-25T16:26:03.628Z","trace_propagation_headers":{"sentry-trace":"e2096cc9c4c943309222c0b75dd1b6b7-4d104757adb24948","baggage":"sentry-trace_id=e2096cc9c4c943309222c0b75dd1b6b7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fdc35031b0cf050bbf451c4ad554e9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:03.640Z","job_size_bytes":2,"pid":1609,"sidekiq_tid":"mae5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f3b35e6fa22d588953df18ab: done: 0.013181 sec","job_status":"done","queue_duration_s":2.434235,"scheduling_latency_s":2.434248,"redis_calls":10,"redis_duration_s":0.001615,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013181,"completed_at":"2026-10-25T16:26:06.087Z","load_balancing_strategy":"primary","db_duration_s":0.001206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 184.032275] runuser[2209]: pam_unix(runuser:session): session closed for user gitlab1674gitlab # [ 184.035881] setup-gitlab-start[2187]: + systemctl restart gitlab-sidekiq.service1675gitlab # [ 184.057782] systemd[1]: Stopping gitlab-sidekiq.service...1676gitlab # [ 184.058253] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:10.553Z","message":"Shutting down"}1677gitlab # [ 184.062632] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:10.558Z","message":"Scheduler exiting..."}1678gitlab # [ 184.062947] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:10.559Z","message":"Terminating quiet threads for default capsule"}1679gitlab # [ 184.069408] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:10.559Z","message":"Scheduler exiting..."}1680gitlab # [ 184.573667] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:11.069Z","message":"Pausing to allow jobs to finish..."}1681gitlab # [ 185.076554] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:11.572Z","message":"Bye!"}1682gitlab # [ 185.099220] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-10-25T16:26:11.595Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1609,"worker_id":"sidekiq_0","memwd_rss_bytes":941584384,"retry":0}1683gitlab # [ 186.200424] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1684gitlab # [ 186.203484] systemd[1]: Stopped gitlab-sidekiq.service.1685gitlab # [ 186.204729] systemd[1]: gitlab-sidekiq.service: Consumed 56.174s CPU time over 1min 53.076s wall clock time, 957.3M memory peak, 4.4M read from disk.1686gitlab # [ 186.215394] systemd[1]: Started gitlab-sidekiq.service.1687gitlab # [ 186.218722] setup-gitlab-start[2187]: + mkdir -p /var/lib/secrets1688gitlab # [ 186.224425] setup-gitlab-start[2187]: + echo nixbot-test-token-of-20-chars1689gitlab # [ 186.226142] setup-gitlab-start[2187]: + chmod 644 /var/lib/secrets/gitlab-token1690gitlab # [ 186.228435] setup-gitlab-start[2187]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1691gitlab # [ 186.434347] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:12 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1741692gitlab # [ 187.246879] gitaly[899]: time="2026-10-25T16:26:13.742Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:23.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:13.742" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1693gitlab # [ 187.255897] gitaly[899]: time="2026-10-25T16:26:13.743Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:23.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:13.742" grpc.time_ms=0.456 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1694gitlab # [ 187.379123] gitaly[899]: time="2026-10-25T16:26:13.875Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:23.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:13.875" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1695gitlab # [ 187.401468] gitaly[899]: time="2026-10-25T16:26:13.875Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:23.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:13.875" grpc.time_ms=0.385 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 187.491639] gitaly[899]: time="2026-10-25T16:26:13.987Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM diskcache=57de1767-6beb-461d-a6d4-182f0691b5fe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T16:26:23.192" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:13.933" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 187.512121] gitaly[899]: time="2026-10-25T16:26:13.987Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1570 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T16:26:23.192" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:13.933" grpc.time_ms=54.416 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 187.528076] gitaly[899]: time="2026-10-25T16:26:14.023Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.023" pid=899 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1699gitlab # [ 187.529310] gitaly[899]: time="2026-10-25T16:26:14.024Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.023" grpc.time_ms=0.702 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700gitlab # [ 187.543991] gitaly[899]: time="2026-10-25T16:26:14.040Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:26:24.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.029" grpc.time_ms=10.352 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 187.599921] gitaly[899]: time="2026-10-25T16:26:14.096Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.075" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.096" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 187.610581] gitaly[899]: time="2026-10-25T16:26:14.096Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.075" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.096" grpc.time_ms=0.276 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 187.642500] gitaly[899]: time="2026-10-25T16:26:14.138Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM diskcache=fd26ebf8-377b-4e49-b017-9c5aa15c8405 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T16:26:24.079" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.099" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 187.642763] gitaly[899]: time="2026-10-25T16:26:14.139Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1582 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-25T16:26:24.079" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.099" grpc.time_ms=39.061 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 187.652859] gitaly[899]: time="2026-10-25T16:26:14.149Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.128" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.148" pid=899 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1706gitlab # [ 187.653801] gitaly[899]: time="2026-10-25T16:26:14.149Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.128" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.148" grpc.time_ms=0.349 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 187.664912] gitaly[899]: time="2026-10-25T16:26:14.161Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:26:24.133" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.153" grpc.time_ms=7.412 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708gitlab # [ 187.689302] gitaly[899]: time="2026-10-25T16:26:14.185Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:26:24.165" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.185" grpc.time_ms=0.095 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 187.693442] gitaly[899]: time="2026-10-25T16:26:14.189Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T16:26:24.169" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.189" grpc.time_ms=0.134 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 188.074879] gitaly[899]: time="2026-10-25T16:26:14.571Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4K2DPEJ4YK2FCKXMRDAM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:26:24.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:14.561" grpc.time_ms=9.968 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 188.425257] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:14 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 19791712gitlab # [ 188.427615] setup-gitlab-start[2459]: {"id":1,"message":null,"error":null}1713gitlab # [ 189.879131] sidekiq-cluster[2446]: {"severity":"INFO","time":"2026-10-25T16:26:16.342Z","message":"Starting cluster with 1 processes"}1714gitlab # [ 193.717160] gitaly[899]: time="2026-10-25T16:26:20.213Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4SXG0DW9VMJCAX2SD2SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:26:30.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:20.205" grpc.time_ms=7.263 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715gitlab # [ 194.138061] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:20 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 6781716gitlab # [ 194.144432] setup-gitlab-start[2187]: + mkdir -p /tmp/test-flake1717gitlab # [ 194.149258] setup-gitlab-start[2187]: + cd /tmp/test-flake1718gitlab # [ 194.150072] setup-gitlab-start[2187]: + git init -b master1719gitlab # [ 194.179496] setup-gitlab-start[2546]: Initialized empty Git repository in /tmp/test-flake/.git/1720gitlab # [ 194.183149] setup-gitlab-start[2187]: + git config user.name test1721gitlab # [ 194.185804] setup-gitlab-start[2187]: + git config user.email test@example.com1722gitlab # [ 194.190080] setup-gitlab-start[2187]: + cat1723gitlab # [ 194.193929] setup-gitlab-start[2187]: + git add flake.nix1724gitlab # [ 194.201191] setup-gitlab-start[2187]: + git commit -m 'initial commit'1725gitlab # [ 194.225994] setup-gitlab-start[2551]: [master (root-commit) a7af69f] initial commit1726gitlab # [ 194.228596] setup-gitlab-start[2551]: 1 file changed, 10 insertions(+)1727gitlab # [ 194.230900] setup-gitlab-start[2551]: create mode 100644 flake.nix1728gitlab # [ 194.231548] setup-gitlab-start[2187]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1729gitlab # [ 194.233970] setup-gitlab-start[2187]: + git push -u origin master1730gitlab # [ 194.323723] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:20 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 571731gitlab # [ 194.447070] gitaly[899]: time="2026-10-25T16:26:20.943Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TRVATX3HN4AYS5WNW3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:20.934" grpc.time_ms=9.087 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1732gitlab # [ 194.460458] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:20 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1291733gitlab # [ 194.681373] gitaly[899]: time="2026-10-25T16:26:21.177Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:26:31.146" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:21.167" grpc.time_ms=10.023 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734gitlab # [ 194.738363] gitaly[899]: time="2026-10-25T16:26:21.233Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-25T16:26:51.027" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-25T16:26:21.227" grpc.time_ms=5.968 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1735gitlab # [ 194.773089] gitaly[899]: time="2026-10-25T16:26:21.269Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 duration_ms=150ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/allowed"1736gitlab # [ 194.804423] gitaly[899]: time="2026-10-25T16:26:21.300Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 duration_ms=30ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/pre_receive"1737gitlab # [ 194.811242] gitaly[899]: time="2026-10-25T16:26:21.307Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:21.117" grpc.time_ms=188.396 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1738gitlab # [ 194.848296] gitaly[899]: time="2026-10-25T16:26:21.344Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:21.342" grpc.time_ms=0.988 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739gitlab # [ 194.881402] gitaly[899]: time="2026-10-25T16:26:21.377Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:21.377" grpc.time_ms=0.328 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1740gitlab # [ 194.916993] gitaly[899]: time="2026-10-25T16:26:21.413Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:21.412" grpc.time_ms=0.392 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1741gitlab # [ 195.018656] gitaly[899]: time="2026-10-25T16:26:21.515Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:26:31.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:21.504" grpc.time_ms=9.934 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 195.070447] gitaly[899]: time="2026-10-25T16:26:21.566Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1562 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-25T16:26:31.046" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:21.546" grpc.time_ms=19.844 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 195.112020] gitaly[899]: time="2026-10-25T16:26:21.608Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 duration_ms=169ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/post_receive"1744gitlab # [ 195.117768] gitaly[899]: time="2026-10-25T16:26:21.614Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:21.438" grpc.time_ms=175.831 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1745gitlab # [ 195.141913] gitaly[899]: time="2026-10-25T16:26:21.638Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 diskcache=fec2d56b-aa27-4317-8ef8-d0fc2760fa8e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:21.051" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1746gitlab # [ 195.142574] gitaly[899]: time="2026-10-25T16:26:21.638Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=178 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13372 command.oublock=32 command.real_time_ms=577 command.spawn_token_fork_ms=1 command.system_time_ms=125 command.user_time_ms=53 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:21.051" grpc.time_ms=586.524 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1747gitlab # [ 195.163909] gitlab-workhorse[822]: time="2026-10-25T16:26:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521748gitlab # [ 195.164663] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:21 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6941749gitlab # [ 195.168380] setup-gitlab-start[2555]: To http://gitlab/root/test-flake.git1750gitlab # [ 195.168742] setup-gitlab-start[2555]: * [new branch] master -> master1751gitlab # [ 195.173254] setup-gitlab-start[2555]: branch 'master' set up to track 'origin/master'.1752gitlab # [ 195.176057] systemd[1]: Finished setup-gitlab.service.1753gitlab # [ 195.181128] systemd[1]: Starting nixbot CI service...1754gitlab: (finished: waiting for unit setup-gitlab.service, in 196.59 seconds)1755gitlab: waiting for unit nixbot.service1756gitlab # [ 196.451352] nixbot[2634]: {"ts": "2026-10-25T16:26:22.946Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1757gitlab # [ 196.486793] nixbot[2634]: {"ts": "2026-10-25T16:26:22.983Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1758gitlab # [ 196.500840] nixbot[2634]: {"ts": "2026-10-25T16:26:22.997Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1759gitlab # [ 196.506090] nixbot[2634]: {"ts": "2026-10-25T16:26:23.002Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1760gitlab # [ 196.510899] nixbot[2634]: {"ts": "2026-10-25T16:26:23.007Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1761gitlab # [ 196.518263] nixbot[2634]: {"ts": "2026-10-25T16:26:23.014Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1762gitlab # [ 196.522860] nixbot[2634]: {"ts": "2026-10-25T16:26:23.019Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1763gitlab # [ 196.527023] nixbot[2634]: {"ts": "2026-10-25T16:26:23.023Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1764gitlab # [ 196.534244] nixbot[2634]: {"ts": "2026-10-25T16:26:23.030Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1765gitlab # [ 196.538360] nixbot[2634]: {"ts": "2026-10-25T16:26:23.034Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1766gitlab # [ 196.543168] nixbot[2634]: {"ts": "2026-10-25T16:26:23.039Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1767gitlab # [ 196.548854] nixbot[2634]: {"ts": "2026-10-25T16:26:23.045Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1768gitlab # [ 196.552321] nixbot[2634]: {"ts": "2026-10-25T16:26:23.048Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1769gitlab # [ 196.554941] nixbot[2634]: {"ts": "2026-10-25T16:26:23.051Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1770gitlab # [ 196.558889] nixbot[2634]: {"ts": "2026-10-25T16:26:23.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1771gitlab # [ 196.561240] nixbot[2634]: {"ts": "2026-10-25T16:26:23.057Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1772gitlab # [ 196.564022] nixbot[2634]: {"ts": "2026-10-25T16:26:23.060Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1773gitlab # [ 196.566461] nixbot[2634]: {"ts": "2026-10-25T16:26:23.062Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1774gitlab # [ 196.571063] nixbot[2634]: {"ts": "2026-10-25T16:26:23.067Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1775gitlab # [ 196.573733] nixbot[2634]: {"ts": "2026-10-25T16:26:23.070Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1776gitlab # [ 196.576532] nixbot[2634]: {"ts": "2026-10-25T16:26:23.072Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1777gitlab # [ 196.581179] nixbot[2634]: {"ts": "2026-10-25T16:26:23.077Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1778gitlab # [ 196.583704] nixbot[2634]: {"ts": "2026-10-25T16:26:23.080Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1779gitlab # [ 196.586579] nixbot[2634]: {"ts": "2026-10-25T16:26:23.082Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1780gitlab # [ 196.589976] nixbot[2634]: {"ts": "2026-10-25T16:26:23.085Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1781gitlab # [ 196.592983] nixbot[2634]: {"ts": "2026-10-25T16:26:23.089Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1782gitlab # [ 196.595782] nixbot[2634]: {"ts": "2026-10-25T16:26:23.092Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1783gitlab # [ 196.598181] nixbot[2634]: {"ts": "2026-10-25T16:26:23.094Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1784gitlab # [ 196.600715] nixbot[2634]: {"ts": "2026-10-25T16:26:23.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1785gitlab # [ 196.609911] nixbot[2634]: {"ts": "2026-10-25T16:26:23.106Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1786gitlab # [ 196.614402] nixbot[2634]: {"ts": "2026-10-25T16:26:23.110Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1787gitlab # [ 196.616949] nixbot[2634]: {"ts": "2026-10-25T16:26:23.113Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1788gitlab # [ 196.619327] nixbot[2634]: {"ts": "2026-10-25T16:26:23.115Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1789gitlab # [ 196.623895] nixbot[2634]: {"ts": "2026-10-25T16:26:23.120Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1790gitlab # [ 196.626258] nixbot[2634]: {"ts": "2026-10-25T16:26:23.122Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1791gitlab # [ 196.631728] nixbot[2634]: {"ts": "2026-10-25T16:26:23.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1792gitlab # [ 196.634720] nixbot[2634]: {"ts": "2026-10-25T16:26:23.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1793gitlab # [ 196.639437] nixbot[2634]: {"ts": "2026-10-25T16:26:23.135Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1794gitlab # [ 196.939453] nixbot[2634]: {"ts": "2026-10-25T16:26:23.435Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2634]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1795gitlab # [ 196.942051] nixbot[2634]: {"ts": "2026-10-25T16:26:23.438Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1796gitlab # [ 196.963393] nixbot[2634]: {"ts": "2026-10-25T16:26:23.459Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:47272 - \"GET /health HTTP/1.1\" 200"}1797gitlab # [ 196.970853] systemd[1]: Started nixbot CI service.1798gitlab # [ 196.972109] systemd[1]: Reached target Multi-User System.1799gitlab # [ 196.973451] systemd[1]: Startup finished in 1.155s (kernel) + 3.491s (initrd) + 3min 12.326s (userspace) = 3min 16.973s.1800gitlab: (finished: waiting for unit nixbot.service, in 1.04 seconds)1801gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1802gitlab # [ 197.020102] nixbot[2634]: {"ts": "2026-10-25T16:26:23.515Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:47274 - \"GET /health HTTP/1.1\" 200"}1803gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1804subtest: project discovered and webhook registered1805gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1806gitlab # [ 197.101177] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 521807gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1808gitlab # [ 197.136876] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:23 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1741809gitlab # [ 197.152184] nixbot[2634]: {"ts": "2026-10-25T16:26:23.648Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1810gitlab # [ 197.200283] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 391811gitlab # [ 197.201873] nixbot[2634]: {"ts": "2026-10-25T16:26:23.698Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1812gitlab # [ 197.342309] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1321813gitlab # [ 197.498501] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:23 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1381814gitlab # [ 197.575764] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 601815gitlab # [ 197.661479] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 791816gitlab # [ 197.748443] gitaly[899]: time="2026-10-25T16:26:24.244Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Y18MKSYKJGGB6JWECNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-25T16:26:54.027" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:24.228" grpc.time_ms=15.593 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 197.778137] gitaly[899]: time="2026-10-25T16:26:24.274Z" level=info msg="finished unary call with code OK" catfile.duration_ms=14 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=14 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Y18MKSYKJGGB6JWECNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:26:54.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:24.258" grpc.time_ms=15.356 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 197.798262] gitaly[899]: time="2026-10-25T16:26:24.294Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Y18MKSYKJGGB6JWECNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-25T16:26:34.259" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:24.280" grpc.time_ms=14.154 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 197.828880] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1561820gitlab # [ 197.923386] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 871821gitlab # [ 197.927316] nixbot[2634]: {"ts": "2026-10-25T16:26:24.423Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1822gitlab # [ 198.071635] gitaly[899]: time="2026-10-25T16:26:24.567Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4YBNH4ZHHZYHA0HV4P02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.556" grpc.time_ms=11.004 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1823gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1824gitlab # [ 198.102523] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 961825gitlab # [ 198.168743] gitaly[899]: time="2026-10-25T16:26:24.663Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YESQMBKAF8X2XGYESE2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.651" pid=899 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1826gitlab # [ 198.186954] gitlab-workhorse[822]: time="2026-10-25T16:26:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131827gitlab # [ 198.193098] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 631828gitlab # [ 198.194943] gitaly[899]: time="2026-10-25T16:26:24.663Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YESQMBKAF8X2XGYESE2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.651" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1830(finished: subtest: project discovered and webhook registered, in 1.18 seconds)1831subtest: push delivers the webhook1832gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1833gitlab # [ 198.206790] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 531834gitlab # [ 198.208645] gitaly[899]: time="2026-10-25T16:26:24.664Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YESQMBKAF8X2XGYESE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.651" grpc.time_ms=12.948 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1835gitlab # [ 198.306182] gitaly[899]: time="2026-10-25T16:26:24.802Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YHGQNB42YJSD0WRVJCN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.786" pid=899 remote_ip="2001:db8:1::1" request_sha=f4fc6e28d2ea52ab3a6f3774ec037224947ca2e6 response_bytes=223 span.kind=server system=grpc1836gitlab # [ 198.306424] gitaly[899]: time="2026-10-25T16:26:24.802Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YHGQNB42YJSD0WRVJCN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.786" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1837gitlab # [ 198.307655] gitaly[899]: time="2026-10-25T16:26:24.803Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YHGQNB42YJSD0WRVJCN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.786" grpc.time_ms=16.87 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1838gitlab # [ 198.371741] gitlab-workhorse[822]: time="2026-10-25T16:26:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231839gitlab # [ 198.372077] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1791840gitlab # [ 198.468865] gitaly[899]: time="2026-10-25T16:26:24.965Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4YRA6Z9NPNC9068P19AJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:24.953" grpc.time_ms=11.479 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1841gitlab # [ 198.496385] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 851842gitlab # [ 198.567398] gitaly[899]: time="2026-10-25T16:26:25.063Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YV11FJ14JCX6ZJYEZGF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.054" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1843gitlab # [ 198.567635] gitaly[899]: time="2026-10-25T16:26:25.063Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YV11FJ14JCX6ZJYEZGF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.054" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1844gitlab # [ 198.568705] gitaly[899]: time="2026-10-25T16:26:25.064Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4YV11FJ14JCX6ZJYEZGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.054" grpc.time_ms=10.666 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1845gitlab # [ 198.569857] gitlab-workhorse[822]: time="2026-10-25T16:26:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671846gitlab # [ 198.571318] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 711847gitlab # [ 198.710267] gitaly[899]: time="2026-10-25T16:26:25.206Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z04Z6QZADXR17BTVFG2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.201" grpc.time_ms=5.367 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1848gitlab # [ 198.711245] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 501849gitlab # [ 198.764373] gitaly[899]: time="2026-10-25T16:26:25.260Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z1TEV5DBZZNN73BTCW6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.240" pid=899 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1850gitlab # [ 198.765116] gitaly[899]: time="2026-10-25T16:26:25.260Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z1TEV5DBZZNN73BTCW6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.240" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1851gitlab # [ 198.766860] gitlab-workhorse[822]: time="2026-10-25T16:26:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091852gitlab # [ 198.768123] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 501853gitlab # [ 198.768945] gitaly[899]: time="2026-10-25T16:26:25.260Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z1TEV5DBZZNN73BTCW6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:25.240" grpc.time_ms=19.592 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1854gitlab # [ 198.886876] gitaly[899]: time="2026-10-25T16:26:25.383Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:26:55.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:25.382" grpc.time_ms=0.985 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 198.958477] gitaly[899]: time="2026-10-25T16:26:25.454Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-25T16:26:55.146" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:25.446" grpc.time_ms=7.735 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 199.001629] gitaly[899]: time="2026-10-25T16:26:25.497Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:26:35.291" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:25.492" grpc.time_ms=5.506 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 199.035692] gitaly[899]: time="2026-10-25T16:26:25.532Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:26:35.023" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:25.523" grpc.time_ms=8.32 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 199.109609] gitaly[899]: time="2026-10-25T16:26:25.605Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T16:26:35.105" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:25.605" grpc.time_ms=0.194 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 199.150530] gitaly[899]: time="2026-10-25T16:26:25.646Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T16:26:35.135" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:25.636" grpc.time_ms=10.327 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 199.215206] gitaly[899]: time="2026-10-25T16:26:25.711Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:25.711" grpc.time_ms=0.298 pid=899 span.kind=server system=grpc1861gitlab # [ 199.240642] gitaly[899]: time="2026-10-25T16:26:25.737Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:26:25.736" grpc.time_ms=0.23 pid=899 span.kind=server system=grpc1862gitlab # [ 199.256755] gitaly[899]: time="2026-10-25T16:26:25.753Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 diskcache=9ac5c695-0383-43e3-904d-b30eb7691521 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T16:26:35.172" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:25.672" pid=899 ref=refs/keep-around/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 remote_ip="2001:db8:1::1" revision=a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 span.kind=server system=grpc username=root1863gitlab # [ 199.266504] gitaly[899]: time="2026-10-25T16:26:25.762Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=53 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5326 command.oublock=8 command.real_time_ms=72 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T16:26:35.172" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:26:25.672" grpc.time_ms=80.344 pid=899 ref=refs/keep-around/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 remote_ip="2001:db8:1::1" revision=a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 span.kind=server system=grpc username=root1864gitlab # [ 199.282145] gitaly[899]: time="2026-10-25T16:26:25.778Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:26:55.477" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:25.778" grpc.time_ms=0.314 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 199.403331] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5581866gitlab # [ 199.414165] nixbot[2634]: {"ts": "2026-10-25T16:26:25.909Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a7af69f448db-0"}1867gitlab # [ 199.567036] nixbot[2634]: {"ts": "2026-10-25T16:26:26.063Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a7af69f448db-0", "argv0": "bwrap"}1868gitlab # [ 199.673186] systemd[1]: Started Nix Daemon.1869gitlab # [ 199.743329] nix-daemon[2794]: accepted connection from pid 2789, user nixbot1870gitlab # [ 204.038975] nix-daemon[2794]: accepted connection from pid 2836, user nixbot1871gitlab # [ 204.054168] nix-daemon[2794]: accepted connection from pid 2789, user nixbot1872gitlab # [ 208.381834] nix-daemon[2794]: accepted connection from pid 2789, user nixbot1873gitlab # [ 208.476821] nix-daemon[2794]: accepted connection from pid 2878, user nixbot1874gitlab # [ 208.510137] gitaly[899]: time="2026-10-25T16:26:35.005Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY58JB9R29DNRQF77B4CHQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:05.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:35.005" grpc.time_ms=0.588 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875gitlab # [ 208.613932] gitaly[899]: time="2026-10-25T16:26:35.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY58JB9R29DNRQF77B4CHQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:26:45.077" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:35.098" grpc.time_ms=11.839 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 208.774307] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3131877gitlab # [ 208.817553] gitaly[899]: time="2026-10-25T16:26:35.313Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY58W9NPJFPT38VSPEM7S6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:05.112" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:35.312" grpc.time_ms=0.757 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 208.860136] gitaly[899]: time="2026-10-25T16:26:35.356Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY58W9NPJFPT38VSPEM7S6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:26:45.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:35.346" grpc.time_ms=10.209 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 208.899691] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1221880gitlab # [ 212.613682] nix-daemon[2794]: accepted connection from pid 2939, user nixbot1881gitlab # [ 212.697473] gitaly[899]: time="2026-10-25T16:26:39.193Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5CN5GRQHS7V6GETZBABC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:09.192" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:26:39.192" grpc.time_ms=0.447 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 212.743244] gitaly[899]: time="2026-10-25T16:26:39.239Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY5CN5GRQHS7V6GETZBABC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:26:49.210" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:26:39.230" grpc.time_ms=8.558 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 212.791461] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1451884gitlab # [ 213.013090] nixbot[2634]: {"ts": "2026-10-25T16:26:39.508Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "a7af69f448db5c6a4e9bc496ac7aa939a2375cf7", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1885gitlab # [ 213.086323] gitaly[899]: time="2026-10-25T16:26:39.582Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY5D1NRTWPHHQTRTRF1KW8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.573" grpc.time_ms=9.414 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1886gitlab # [ 213.103544] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 581887gitlab # [ 213.179563] gitaly[899]: time="2026-10-25T16:26:39.675Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5D3K5K88EK3XXNN2DG18 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.664" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1888gitlab # [ 213.179963] gitaly[899]: time="2026-10-25T16:26:39.676Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5D3K5K88EK3XXNN2DG18 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.664" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1889gitlab # [ 213.182420] gitaly[899]: time="2026-10-25T16:26:39.676Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5D3K5K88EK3XXNN2DG18 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.664" grpc.time_ms=11.827 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab # [ 213.184389] gitlab-workhorse[822]: time="2026-10-25T16:26:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671891gitlab # [ 213.186139] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 731892gitlab # [ 213.297113] gitaly[899]: time="2026-10-25T16:26:39.792Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY5D8AH87S1FM1B31CRT0C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.786" grpc.time_ms=6.045 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1893gitlab # [ 213.297366] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 381894gitlab # [ 213.356209] gitaly[899]: time="2026-10-25T16:26:39.852Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5DA1BP2XPQQJH66YWFAH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.846" pid=899 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1895gitlab # [ 213.356642] gitaly[899]: time="2026-10-25T16:26:39.852Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5DA1BP2XPQQJH66YWFAH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.846" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1896gitlab # [ 213.380358] gitaly[899]: time="2026-10-25T16:26:39.876Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY5DA1BP2XPQQJH66YWFAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:26:39.846" grpc.time_ms=29.702 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 213.380710] gitlab-workhorse[822]: time="2026-10-25T16:26:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671898gitlab # [ 213.381222] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:26:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 671899gitlab # [ 214.358327] sidekiq-cluster[2511]: 2026-10-25T16:26:40.853Z pid=2511 tid=xuv INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2511, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431292416}1900gitlab # [ 214.525602] sidekiq-cluster[2511]: W, [2026-10-25T16:26:41.021795 #2511] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1901gitlab # [ 214.562462] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:26:41.058Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1902gitlab # [ 216.230691] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:26:42.726Z","message":"GitLab reliable fetch activated!"}1903gitlab # [ 216.231517] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:26:42.726Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1904gitlab # [ 235.632641] postgres[3181]: [3181] ERROR: relation "table_without_models" does not exist1905gitlab # [ 235.633074] postgres[3181]: [3181] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1906gitlab # [ 238.016247] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:04.512Z","message":"Booted Rails 7.2.3.1 application in production environment"}1907gitlab # [ 238.018713] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:04.514Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1908gitlab # [ 238.020579] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:04.514Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1909gitlab # [ 238.022659] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:04.514Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1910gitlab # [ 238.024653] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:04.516Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1911gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.37 seconds)1912gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1913gitlab # [ 238.669289] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:05 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 361914gitlab # [ 238.730071] gitaly[899]: time="2026-10-25T16:27:05.225Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY662D0QMR09Y90M5SGJ34 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:05.213" grpc.time_ms=11.882 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1915gitlab # Enumerating objects: 5, done.1916gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1917gitlab # Delta compression using up to 4 threads1918gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1919gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1920gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1921gitlab # [ 238.772093] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:05 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 601922gitlab # [ 239.003947] gitaly[899]: time="2026-10-25T16:27:05.500Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-25T16:27:35.188" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-25T16:27:05.489" grpc.time_ms=10.97 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 239.070739] gitaly[899]: time="2026-10-25T16:27:05.566Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5SY665N8QSKWP5FRFRD55SY duration_ms=141ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/allowed"1924gitlab # [ 239.125161] gitaly[899]: time="2026-10-25T16:27:05.620Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5SY665N8QSKWP5FRFRD55SY duration_ms=45ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/pre_receive"1925gitlab # [ 239.135458] gitaly[899]: time="2026-10-25T16:27:05.621Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:05.424" grpc.time_ms=196.416 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1926gitlab # [ 239.198264] gitaly[899]: time="2026-10-25T16:27:05.694Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:05.691" grpc.time_ms=2.37 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1927gitlab # [ 239.261924] gitaly[899]: time="2026-10-25T16:27:05.758Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:05.756" grpc.time_ms=1.063 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1928gitlab # [ 239.315984] gitaly[899]: time="2026-10-25T16:27:05.812Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:05.811" grpc.time_ms=0.581 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1929gitlab # [ 239.373539] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:05.869Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5a8944b14cce2fb56a6c6b2e","created_at":"2026-10-25T16:26:14.052Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.078Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5a8944b14cce2fb56a6c6b2e: start","job_status":"start","queue_duration_s":51.790476,"scheduling_latency_s":51.790516}1930gitlab # [ 239.428893] gitaly[899]: time="2026-10-25T16:27:05.925Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5SY665N8QSKWP5FRFRD55SY duration_ms=58ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/post_receive"1931gitlab # [ 239.437919] gitaly[899]: time="2026-10-25T16:27:05.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:05.866" grpc.time_ms=59.3 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1932gitlab # To http://gitlab/root/test-flake.git1933gitlab # a7af69f..43b3ea3 master -> master1934gitlab # [ 239.460000] gitaly[899]: time="2026-10-25T16:27:05.945Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY diskcache=93283685-46b0-4ce4-ad0c-e0965c540b94 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:05.352" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1935gitlab # [ 239.460352] gitlab-workhorse[822]: time="2026-10-25T16:27:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521936gitlab # [ 239.460761] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:05 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6771937gitlab # [ 239.461442] gitaly[899]: time="2026-10-25T16:27:05.946Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=237 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13568 command.oublock=32 command.real_time_ms=580 command.spawn_token_fork_ms=0 command.system_time_ms=155 command.user_time_ms=82 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:05.352" grpc.time_ms=593.754 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.91 seconds)1939gitlab: must succeed: git -C /tmp/test-flake rev-parse master1940gitlab # [ 239.493021] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:05.989Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"5a8944b14cce2fb56a6c6b2e","created_at":"2026-10-25T16:26:14.052Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.078Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-5a8944b14cce2fb56a6c6b2e: done: 0.119872 sec","job_status":"done","queue_duration_s":51.790476,"scheduling_latency_s":51.790516,"redis_calls":25,"redis_duration_s":0.004801,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002884,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.064553456,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.119872,"completed_at":"2026-10-25T16:27:05.989Z","load_balancing_strategy":"primary","db_duration_s":0.037598,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1941gitlab # [ 239.494145] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:05.990Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"540317411820789b1a5c4118","created_at":"2026-10-25T16:26:14.086Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.092Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-540317411820789b1a5c4118: start","job_status":"start","queue_duration_s":51.897986,"scheduling_latency_s":51.898001}1942gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.06 seconds)1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd'1944gitlab # [ 239.561783] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.057Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"540317411820789b1a5c4118","created_at":"2026-10-25T16:26:14.086Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.092Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-540317411820789b1a5c4118: done: 0.067408 sec","job_status":"done","queue_duration_s":51.897986,"scheduling_latency_s":51.898001,"redis_calls":14,"redis_duration_s":0.002376,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000389,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.051432794000000004,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.067408,"completed_at":"2026-10-25T16:27:06.057Z","load_balancing_strategy":"primary","db_duration_s":0.013396,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1945gitlab # [ 239.602290] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.098Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"710eb84f4490836e2e001166","created_at":"2026-10-25T16:26:14.491Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.496Z","job_size_bytes":5,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-710eb84f4490836e2e001166: start","job_status":"start","queue_duration_s":51.601591,"scheduling_latency_s":51.60162}1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd', in 0.07 seconds)1947gitlab # [ 239.614388] nixbot[2634]: {"ts": "2026-10-25T16:27:06.110Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:40114 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1\" 200"}1948gitlab # [ 239.755226] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.251Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"710eb84f4490836e2e001166","created_at":"2026-10-25T16:26:14.491Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.496Z","job_size_bytes":5,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-710eb84f4490836e2e001166: done: 0.152901 sec","job_status":"done","queue_duration_s":51.601591,"scheduling_latency_s":51.60162,"redis_calls":12,"redis_duration_s":0.0026060000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000569,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001628,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288584,"duration_s":0.152901,"completed_at":"2026-10-25T16:27:06.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024623,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1949gitlab # [ 239.757703] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.252Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"0702f0c7ab91ac0caca84d16","created_at":"2026-10-25T16:26:14.516Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.519Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-0702f0c7ab91ac0caca84d16: start","job_status":"start","queue_duration_s":51.73257,"scheduling_latency_s":51.732584}1950gitlab # [ 239.927673] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.423Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"0702f0c7ab91ac0caca84d16","created_at":"2026-10-25T16:26:14.516Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.519Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-0702f0c7ab91ac0caca84d16: done: 0.170806 sec","job_status":"done","queue_duration_s":51.73257,"scheduling_latency_s":51.732584,"redis_calls":11,"redis_duration_s":0.002532,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.14,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.14,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000443632,"duration_s":0.170806,"completed_at":"2026-10-25T16:27:06.423Z","load_balancing_strategy":"primary","db_duration_s":0.074447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 239.930239] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.425Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"5c17f0638359607639ad76b6","created_at":"2026-10-25T16:26:14.522Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.524Z","job_size_bytes":89,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-5c17f0638359607639ad76b6: start","job_status":"start","queue_duration_s":51.900283,"scheduling_latency_s":51.900309}1952gitlab # [ 240.001322] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.460Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"5c17f0638359607639ad76b6","created_at":"2026-10-25T16:26:14.522Z","trace_propagation_headers":{"sentry-trace":"ac3290ca206e483a9a43f58cc356f3e9-da8324e384524981","baggage":"sentry-trace_id=ac3290ca206e483a9a43f58cc356f3e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4K2DPEJ4YK2FCKXMRDAM","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:14.524Z","job_size_bytes":89,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-5c17f0638359607639ad76b6: done: 0.035524 sec","job_status":"done","queue_duration_s":51.900283,"scheduling_latency_s":51.900309,"redis_calls":11,"redis_duration_s":0.003146,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001093,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035647,"duration_s":0.035524,"completed_at":"2026-10-25T16:27:06.460Z","load_balancing_strategy":"primary","db_duration_s":0.006342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1953gitlab # [ 240.015171] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.462Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"da9f52c6f121cdb9e908bb08","created_at":"2026-10-25T16:26:21.464Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-6b61f87808984bd3","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:21.483Z","job_size_bytes":185,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-da9f52c6f121cdb9e908bb08: start","job_status":"start","queue_duration_s":44.978588,"scheduling_latency_s":44.978602}1954gitlab # [ 240.031118] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:06.473Z","message":"changes: \"0000000000000000000000000000000000000000 a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 refs/heads/master\\n\""}1955gitlab # [ 240.034075] gitaly[899]: time="2026-10-25T16:27:06.500Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:16.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:06.494" grpc.time_ms=6.11 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 240.078925] gitaly[899]: time="2026-10-25T16:27:06.568Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=63 command.spawn_token_fork_ms=54 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:27:16.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:06.504" grpc.time_ms=64.37 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957gitlab # [ 240.114489] gitaly[899]: time="2026-10-25T16:27:06.610Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-25T16:27:16.109" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:06.599" grpc.time_ms=10.847 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 240.147840] gitaly[899]: time="2026-10-25T16:27:06.644Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:06.643" grpc.time_ms=0.299 pid=899 span.kind=server system=grpc1959gitlab # [ 240.174604] gitaly[899]: time="2026-10-25T16:27:06.670Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:06.670" grpc.time_ms=0.284 pid=899 span.kind=server system=grpc1960gitlab # [ 240.194833] gitaly[899]: time="2026-10-25T16:27:06.691Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 diskcache=379ab5b5-8c54-48b3-8be3-658115f17fd4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T16:27:16.134" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:06.625" pid=899 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1961gitlab # [ 240.195116] gitaly[899]: time="2026-10-25T16:27:06.691Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=53 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5185 command.oublock=8 command.real_time_ms=57 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T16:27:16.134" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:06.625" grpc.time_ms=66.22 pid=899 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1962gitlab # [ 240.206636] gitaly[899]: time="2026-10-25T16:27:06.703Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-25T16:27:16.212" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:06.702" grpc.time_ms=0.244 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab # [ 240.218271] gitaly[899]: time="2026-10-25T16:27:06.714Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=935 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-25T16:27:16.215" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:06.705" grpc.time_ms=8.665 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 240.323474] gitaly[899]: time="2026-10-25T16:27:06.819Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-25T16:27:36.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:06.811" grpc.time_ms=8.371 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 240.362116] gitaly[899]: time="2026-10-25T16:27:06.858Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T16:27:16.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:06.857" grpc.time_ms=0.307 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 240.387423] gitaly[899]: time="2026-10-25T16:27:06.883Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-25T16:27:16.026" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-25T16:27:06.876" grpc.time_ms=6.996 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 240.415559] gitaly[899]: time="2026-10-25T16:27:06.911Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:16.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:06.902" grpc.time_ms=9.639 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 240.444514] gitaly[899]: time="2026-10-25T16:27:06.940Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:16.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:06.930" grpc.time_ms=10.274 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 240.479505] gitaly[899]: time="2026-10-25T16:27:06.975Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-25T16:27:36.156" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:06.956" grpc.time_ms=18.499 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd'1971gitlab # [ 240.659572] nixbot[2634]: {"ts": "2026-10-25T16:27:07.155Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:40120 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1\" 200"}1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd', in 0.05 seconds)1973gitlab # [ 240.866108] gitaly[899]: time="2026-10-25T16:27:07.362Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-25T16:27:17.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:07.360" grpc.time_ms=1.194 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 240.890494] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.385Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"da9f52c6f121cdb9e908bb08","created_at":"2026-10-25T16:26:21.464Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-6b61f87808984bd3","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:26:21.483Z","job_size_bytes":185,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-da9f52c6f121cdb9e908bb08: done: 0.923917 sec","job_status":"done","queue_duration_s":44.978588,"scheduling_latency_s":44.978602,"gitaly_calls":13,"gitaly_duration_s":0.276364,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.041574,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.004178,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006527,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001421,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004292,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.015014,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010142,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.17,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.199,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.545204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000441397,"exclusive_lock_hold_duration_s":0.019787152,"duration_s":0.923917,"completed_at":"2026-10-25T16:27:07.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.091306,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1975gitlab # [ 240.907323] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.387Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"777fffc4f02f7bff6c2635fa","created_at":"2026-10-25T16:26:25.793Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.798Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-777fffc4f02f7bff6c2635fa: start","job_status":"start","queue_duration_s":41.588838,"scheduling_latency_s":41.588853}1976gitlab # [ 240.980979] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.476Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"777fffc4f02f7bff6c2635fa","created_at":"2026-10-25T16:26:25.793Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.798Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-777fffc4f02f7bff6c2635fa: done: 0.089677 sec","job_status":"done","queue_duration_s":41.588838,"scheduling_latency_s":41.588853,"redis_calls":16,"redis_duration_s":0.003084,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001638,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220978,"duration_s":0.089677,"completed_at":"2026-10-25T16:27:07.476Z","load_balancing_strategy":"primary","db_duration_s":0.050007,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1977gitlab # [ 240.982153] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.478Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"12db304ca9d2cffbd32ad0da","created_at":"2026-10-25T16:26:25.798Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.801Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-12db304ca9d2cffbd32ad0da: start","job_status":"start","queue_duration_s":41.677045,"scheduling_latency_s":41.67706}1978gitlab # [ 241.051630] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.547Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"12db304ca9d2cffbd32ad0da","created_at":"2026-10-25T16:26:25.798Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.801Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-12db304ca9d2cffbd32ad0da: done: 0.069285 sec","job_status":"done","queue_duration_s":41.677045,"scheduling_latency_s":41.67706,"redis_calls":21,"redis_duration_s":0.004058,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001691,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000304788,"duration_s":0.069285,"completed_at":"2026-10-25T16:27:07.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1979gitlab # [ 241.053402] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.549Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d5c9d1c83649936806bafadc","created_at":"2026-10-25T16:26:25.881Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.886Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d5c9d1c83649936806bafadc: start","job_status":"start","queue_duration_s":41.662761,"scheduling_latency_s":41.662775}1980gitlab # [ 241.178163] gitaly[899]: time="2026-10-25T16:27:07.673Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:07.673" grpc.time_ms=0.308 pid=899 span.kind=server system=grpc1981gitlab # [ 241.209531] gitaly[899]: time="2026-10-25T16:27:07.705Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:07.705" grpc.time_ms=0.297 pid=899 span.kind=server system=grpc1982gitlab # [ 241.253090] gitaly[899]: time="2026-10-25T16:27:07.749Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:07.748" grpc.time_ms=0.585 pid=899 span.kind=server system=grpc1983gitlab # [ 241.272143] gitaly[899]: time="2026-10-25T16:27:07.768Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 diskcache=5f1e515f-d769-4768-a29e-0ff47d813312 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:37.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:07.646" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 241.281451] gitaly[899]: time="2026-10-25T16:27:07.777Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=117 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7350 command.oublock=0 command.real_time_ms=112 command.spawn_token_fork_ms=0 command.system_time_ms=76 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:37.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:07.646" grpc.time_ms=121.834 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 241.404185] gitaly[899]: time="2026-10-25T16:27:07.900Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:37.098" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:07.899" grpc.time_ms=1.187 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 241.433498] gitaly[899]: time="2026-10-25T16:27:07.929Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4Z5WWFV2VTQDB4N3K512 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:37.128" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:07.928" grpc.time_ms=0.97 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 241.472415] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d5c9d1c83649936806bafadc","created_at":"2026-10-25T16:26:25.881Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.886Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2511,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d5c9d1c83649936806bafadc: rescheduled"}1988gitlab # [ 241.485599] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:07.981Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d5c9d1c83649936806bafadc","created_at":"2026-10-25T16:26:25.881Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-5d7f192fb0d3431c","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:26:25.886Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d5c9d1c83649936806bafadc: done: 0.432055 sec","job_status":"done","queue_duration_s":41.662761,"scheduling_latency_s":41.662775,"gitaly_calls":3,"gitaly_duration_s":0.173817,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.027683,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00109,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001354,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009812,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004138,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006128,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000567,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000678,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002826,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.168468,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.37786422599999997,"duration_s":0.432055,"completed_at":"2026-10-25T16:27:07.981Z","load_balancing_strategy":"primary","db_duration_s":0.070557,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1989gitlab # [ 241.548880] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.044Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 43b3ea314fe878bc7ebde23450b44215d801b8bd refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a481e32a3eeca2a3232af34a","created_at":"2026-10-25T16:27:05.898Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-62d7839bcf3d46f6","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:27:05.901Z","job_size_bytes":185,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a481e32a3eeca2a3232af34a: start","job_status":"start","queue_duration_s":2.143608,"scheduling_latency_s":2.143653}1990gitlab # [ 241.578578] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.074Z","message":"changes: \"a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 43b3ea314fe878bc7ebde23450b44215d801b8bd refs/heads/master\\n\""}1991gitlab # [ 241.609290] gitaly[899]: time="2026-10-25T16:27:08.105Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:18.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:08.094" grpc.time_ms=10.656 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 241.635170] gitaly[899]: time="2026-10-25T16:27:08.131Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-25T16:27:18.033" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:08.123" grpc.time_ms=8 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 241.641241] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.137Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"7760da936f6209df4f401ade","created_at":"2026-10-25T16:27:08.134Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"ef9b9d35d25b9993007d4feb","job_size_bytes":46,"pid":2511,"job_status":"deduplicated","message":"ProjectCacheWorker JID-7760da936f6209df4f401ade: deduplicated: until executing","deduplication.type":"until executing"}1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd'1995gitlab # [ 241.665099] gitaly[899]: time="2026-10-25T16:27:08.161Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-25T16:27:18.062" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:08.152" grpc.time_ms=8.352 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 241.680762] gitaly[899]: time="2026-10-25T16:27:08.177Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-25T16:27:38.064" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.165" grpc.time_ms=11.898 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 241.693539] gitaly[899]: time="2026-10-25T16:27:08.189Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-25T16:27:18.095" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-25T16:27:08.185" grpc.time_ms=3.874 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 241.708685] nixbot[2634]: {"ts": "2026-10-25T16:27:08.202Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:40130 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1\" 200"}1999gitlab # [ 241.709394] gitaly[899]: time="2026-10-25T16:27:08.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:18.105" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:08.195" grpc.time_ms=8.847 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd', in 0.06 seconds)2001gitlab # [ 241.773832] gitaly[899]: time="2026-10-25T16:27:08.270Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-25T16:27:18.178" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.269" grpc.time_ms=1.005 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 241.796424] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.292Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 43b3ea314fe878bc7ebde23450b44215d801b8bd refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a481e32a3eeca2a3232af34a","created_at":"2026-10-25T16:27:05.898Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-62d7839bcf3d46f6","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-25T16:27:05.901Z","job_size_bytes":185,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a481e32a3eeca2a3232af34a: done: 0.247812 sec","job_status":"done","queue_duration_s":2.143608,"scheduling_latency_s":2.143653,"gitaly_calls":7,"gitaly_duration_s":0.080684,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.019937,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001626,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000876,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003732,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006949,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.006754,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000624381,"exclusive_lock_hold_duration_s":0.032603027,"duration_s":0.247812,"completed_at":"2026-10-25T16:27:08.292Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019725,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2003gitlab # [ 241.800994] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.293Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ef9b9d35d25b9993007d4feb","created_at":"2026-10-25T16:27:06.571Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:06.584Z","job_size_bytes":46,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ef9b9d35d25b9993007d4feb: start","job_status":"start","queue_duration_s":1.709041,"scheduling_latency_s":1.709058}2004gitlab # [ 241.830345] gitaly[899]: time="2026-10-25T16:27:08.326Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-25T22:27:08.324" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:08.324" grpc.time_ms=2.121 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 241.843781] gitaly[899]: time="2026-10-25T16:27:08.340Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-25T16:27:38.231" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.332" grpc.time_ms=8.04 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 241.863051] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.359Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ef9b9d35d25b9993007d4feb","created_at":"2026-10-25T16:27:06.571Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:06.584Z","job_size_bytes":46,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ef9b9d35d25b9993007d4feb: done: 0.065275 sec","job_status":"done","queue_duration_s":1.709041,"scheduling_latency_s":1.709058,"gitaly_calls":2,"gitaly_duration_s":0.013307,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006928,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001188,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000529,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003101,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000676,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026428,"duration_s":0.065275,"completed_at":"2026-10-25T16:27:08.359Z","load_balancing_strategy":"primary","db_duration_s":0.011916,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2007gitlab # [ 241.918363] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.360Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"190697f54544c3a95efd00b2","created_at":"2026-10-25T16:27:06.593Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:06.596Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-190697f54544c3a95efd00b2: start","job_status":"start","queue_duration_s":1.763744,"scheduling_latency_s":1.763758}2008gitlab # [ 241.919228] gitaly[899]: time="2026-10-25T16:27:08.402Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 diskcache=c226106a-dda3-48a6-b917-043dfccfe862 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T22:27:08.376" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.376" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 241.919756] gitaly[899]: time="2026-10-25T16:27:08.403Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1286 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T22:27:08.376" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.376" grpc.time_ms=26.022 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 241.935421] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.431Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"190697f54544c3a95efd00b2","created_at":"2026-10-25T16:27:06.593Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:06.596Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-190697f54544c3a95efd00b2: done: 0.07119 sec","job_status":"done","queue_duration_s":1.763744,"scheduling_latency_s":1.763758,"gitaly_calls":1,"gitaly_duration_s":0.028191,"redis_calls":15,"redis_duration_s":0.00299,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00057,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.055384973000000004,"duration_s":0.07119,"completed_at":"2026-10-25T16:27:08.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2011gitlab # [ 241.990975] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.432Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f95cfec10ed5fb664c6b75fc","created_at":"2026-10-25T16:27:06.698Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:06.700Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f95cfec10ed5fb664c6b75fc: start","job_status":"start","queue_duration_s":1.732624,"scheduling_latency_s":1.732638}2012gitlab # [ 241.991669] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.467Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f95cfec10ed5fb664c6b75fc","created_at":"2026-10-25T16:27:06.698Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:06.700Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f95cfec10ed5fb664c6b75fc: done: 0.034702 sec","job_status":"done","queue_duration_s":1.732624,"scheduling_latency_s":1.732638,"gitaly_calls":1,"gitaly_duration_s":0.009819,"redis_calls":16,"redis_duration_s":0.003536,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000265,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001595,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034702,"completed_at":"2026-10-25T16:27:08.467Z","load_balancing_strategy":"primary","db_duration_s":0.002774,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2013gitlab # [ 242.034146] gitaly[899]: time="2026-10-25T16:27:08.459Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-25T16:27:38.351" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.451" grpc.time_ms=7.995 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 242.035751] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:08.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3f6231a2671b217702460580","created_at":"2026-10-25T16:27:07.187Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad04eb605024b37dce13be145b0506b6e9f12d8d6dcfa1ff2c24d37cb0495736","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.191Z","job_size_bytes":467,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3f6231a2671b217702460580: start","job_status":"start","queue_duration_s":1.277852,"scheduling_latency_s":1.277871}2015gitlab # [ 242.078046] gitaly[899]: time="2026-10-25T16:27:08.489Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:38.387" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.488" grpc.time_ms=0.676 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 242.078656] gitaly[899]: time="2026-10-25T16:27:08.498Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T16:27:18.140" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:08.490" grpc.time_ms=7.884 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # [ 242.084664] gitaly[899]: time="2026-10-25T16:27:08.581Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:38.479" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.580" grpc.time_ms=0.859 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 242.093233] gitaly[899]: time="2026-10-25T16:27:08.589Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=324 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-25T16:27:38.485" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:08.585" grpc.time_ms=4.029 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 242.176447] gitaly[899]: time="2026-10-25T16:27:08.672Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:18.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:08.667" grpc.time_ms=5.133 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 242.611443] gitaly[899]: time="2026-10-25T16:27:09.107Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-25T16:27:39.091" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.091" grpc.time_ms=14.957 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 242.661128] gitaly[899]: time="2026-10-25T16:27:09.157Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY4TX5WT3EDQVCW2JFHWE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-25T16:27:39.040" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.141" grpc.time_ms=16.003 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 242.697416] sidekiq-cluster[2511]: {"severity":"WARN","time":"2026-10-25T16:27:09.193Z","class":"CreatePipelineWorker","correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a7af69f448db5c6a4e9bc496ac7aa939a2375cf7","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a7af69f448db5c6a4e9bc496ac7aa939a2375cf7","ref":"refs/heads/master"},"retry":0}2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd'2024gitlab # [ 242.706839] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3f6231a2671b217702460580","created_at":"2026-10-25T16:27:07.187Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad04eb605024b37dce13be145b0506b6e9f12d8d6dcfa1ff2c24d37cb0495736","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.191Z","job_size_bytes":467,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3f6231a2671b217702460580: done: 0.733732 sec","job_status":"done","queue_duration_s":1.277852,"scheduling_latency_s":1.277871,"gitaly_calls":7,"gitaly_duration_s":0.097342,"redis_calls":51,"redis_duration_s":0.008896,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000656,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.00414,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002039,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.579268,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000445029,"duration_s":0.733732,"completed_at":"2026-10-25T16:27:09.202Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044685,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2025gitlab # [ 242.754322] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.205Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5b6a6063-02e1-4e28-b61a-9b99cf2a7dba\"}"],"class":"WebHookWorker","jid":"a07f2ce425e9f5fe9827f1cc","created_at":"2026-10-25T16:27:07.336Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1cb1189e0309624c16c79be80fce5817888cb0b2ff88307f8ac83d986ae855a6","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.341Z","job_size_bytes":1751,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a07f2ce425e9f5fe9827f1cc: start","job_status":"start","queue_duration_s":1.863169,"scheduling_latency_s":1.863195}2026gitlab # [ 242.789166] nixbot[2634]: {"ts": "2026-10-25T16:27:09.285Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:40146 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1\" 200"}2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd', in 0.07 seconds)2028gitlab # [ 242.826963] nixbot[2634]: {"ts": "2026-10-25T16:27:09.323Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "876ce4ff-61f5-4340-affd-473ea7a2b1d7", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "a7af69f448db5c6a4e9bc496ac7aa939a2375cf7", "pr": null}2029gitlab # [ 242.831967] nixbot[2634]: {"ts": "2026-10-25T16:27:09.328Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:40154 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}2030gitlab # [ 242.857378] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.353Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5b6a6063-02e1-4e28-b61a-9b99cf2a7dba\"}"],"class":"WebHookWorker","jid":"a07f2ce425e9f5fe9827f1cc","created_at":"2026-10-25T16:27:07.336Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-66b3355886014853","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1cb1189e0309624c16c79be80fce5817888cb0b2ff88307f8ac83d986ae855a6","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.341Z","job_size_bytes":1751,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-a07f2ce425e9f5fe9827f1cc: done: 0.148236 sec","job_status":"done","queue_duration_s":1.863169,"scheduling_latency_s":1.863195,"redis_calls":19,"redis_duration_s":0.004168,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001038,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00033,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001917,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04018471699998827,"cpu_s":0.090806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000386641,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.148236,"completed_at":"2026-10-25T16:27:09.353Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 242.911056] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3e76215b1789d1736525a893","created_at":"2026-10-25T16:27:07.634Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.638Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3e76215b1789d1736525a893: start","job_status":"start","queue_duration_s":1.768333,"scheduling_latency_s":1.768361}2032gitlab # [ 242.972530] gitaly[899]: time="2026-10-25T16:27:09.468Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6A6ZDRY8EZ4T3D8YYDX5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.458" grpc.time_ms=10.144 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2033gitlab # [ 242.987185] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 752034gitlab # [ 243.020799] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.515Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3e76215b1789d1736525a893","created_at":"2026-10-25T16:27:07.634Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.638Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3e76215b1789d1736525a893: done: 0.108976 sec","job_status":"done","queue_duration_s":1.768333,"scheduling_latency_s":1.768361,"redis_calls":10,"redis_duration_s":0.010054,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000424356,"duration_s":0.108976,"completed_at":"2026-10-25T16:27:09.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022706,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2035gitlab # [ 243.067833] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.563Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7c0dc33ff46a05b80034e3a9","created_at":"2026-10-25T16:27:07.796Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.803Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7c0dc33ff46a05b80034e3a9: start","job_status":"start","queue_duration_s":1.76009,"scheduling_latency_s":1.760119}2036gitlab # [ 243.094082] gitaly[899]: time="2026-10-25T16:27:09.590Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6A9EJXAYYDYHWTS7V6C5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.562" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2037gitlab # [ 243.094871] gitaly[899]: time="2026-10-25T16:27:09.590Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=17 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6A9EJXAYYDYHWTS7V6C5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.562" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2038gitlab # [ 243.095890] gitlab-workhorse[822]: time="2026-10-25T16:27:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672039gitlab # [ 243.096772] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1042040gitlab # [ 243.097729] gitaly[899]: time="2026-10-25T16:27:09.590Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=17 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6A9EJXAYYDYHWTS7V6C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.562" grpc.time_ms=27.788 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # [ 243.101907] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.597Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7c0dc33ff46a05b80034e3a9","created_at":"2026-10-25T16:27:07.796Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.803Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7c0dc33ff46a05b80034e3a9: done: 0.034788 sec","job_status":"done","queue_duration_s":1.76009,"scheduling_latency_s":1.760119,"redis_calls":10,"redis_duration_s":0.00247,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000453969,"duration_s":0.034788,"completed_at":"2026-10-25T16:27:09.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2042gitlab # [ 243.151842] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5e9218443dda1bfe9a33fa53","created_at":"2026-10-25T16:27:07.818Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.827Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5e9218443dda1bfe9a33fa53: start","job_status":"start","queue_duration_s":1.774081,"scheduling_latency_s":1.774099}2043gitlab # [ 243.152602] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5e9218443dda1bfe9a33fa53","created_at":"2026-10-25T16:27:07.818Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.827Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5e9218443dda1bfe9a33fa53: done: 0.026535 sec","job_status":"done","queue_duration_s":1.774081,"scheduling_latency_s":1.774099,"redis_calls":10,"redis_duration_s":0.00195,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239416,"duration_s":0.026535,"completed_at":"2026-10-25T16:27:09.628Z","load_balancing_strategy":"primary","db_duration_s":0.00446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 243.230655] gitaly[899]: time="2026-10-25T16:27:09.722Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6ACR6QBV85YTC1TBBJRB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.702" pid=899 remote_ip="2001:db8:1::1" request_sha=748be3433471feb9c60011ac492ef6604da9e03d response_bytes=336 span.kind=server system=grpc2045gitlab # [ 243.231564] gitlab-workhorse[822]: time="2026-10-25T16:27:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3362046gitlab # [ 243.232198] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 1302047gitlab # [ 243.232644] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d27c215fa57241f11fb50dcc","created_at":"2026-10-25T16:27:07.843Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.848Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d27c215fa57241f11fb50dcc: start","job_status":"start","queue_duration_s":1.7806,"scheduling_latency_s":1.780612}2048gitlab # [ 243.233229] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.654Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d27c215fa57241f11fb50dcc","created_at":"2026-10-25T16:27:07.843Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.848Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d27c215fa57241f11fb50dcc: done: 0.025199 sec","job_status":"done","queue_duration_s":1.7806,"scheduling_latency_s":1.780612,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000377,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000211759,"duration_s":0.025199,"completed_at":"2026-10-25T16:27:09.654Z","load_balancing_strategy":"primary","db_duration_s":0.005632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2049gitlab # [ 243.271568] gitaly[899]: time="2026-10-25T16:27:09.722Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6ACR6QBV85YTC1TBBJRB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.702" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2050gitlab # [ 243.309522] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a7018348347c853db2943be7","created_at":"2026-10-25T16:27:07.849Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.853Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a7018348347c853db2943be7: start","job_status":"start","queue_duration_s":1.801686,"scheduling_latency_s":1.801723}2051gitlab # [ 243.310212] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a7018348347c853db2943be7","created_at":"2026-10-25T16:27:07.849Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.853Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a7018348347c853db2943be7: done: 0.024186 sec","job_status":"done","queue_duration_s":1.801686,"scheduling_latency_s":1.801723,"redis_calls":10,"redis_duration_s":0.002331,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000852,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257575,"duration_s":0.024186,"completed_at":"2026-10-25T16:27:09.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2052gitlab # [ 243.355149] gitaly[899]: time="2026-10-25T16:27:09.723Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6ACR6QBV85YTC1TBBJRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:09.702" grpc.time_ms=19.937 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2053gitlab # [ 243.355934] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8b60bb5102179c8ff833630c","created_at":"2026-10-25T16:27:07.854Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.859Z","job_size_bytes":19,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8b60bb5102179c8ff833630c: start","job_status":"start","queue_duration_s":1.821038,"scheduling_latency_s":1.821051}2054gitlab # [ 243.360134] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8b60bb5102179c8ff833630c","created_at":"2026-10-25T16:27:07.854Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.859Z","job_size_bytes":19,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8b60bb5102179c8ff833630c: done: 0.020201 sec","job_status":"done","queue_duration_s":1.821038,"scheduling_latency_s":1.821051,"redis_calls":11,"redis_duration_s":0.001969,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.020201,"completed_at":"2026-10-25T16:27:09.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 243.416399] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.701Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f21d75165df2914a7f43fbfb","created_at":"2026-10-25T16:27:07.863Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.865Z","job_size_bytes":66,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f21d75165df2914a7f43fbfb: start","job_status":"start","queue_duration_s":1.835983,"scheduling_latency_s":1.835996}2056gitlab # [ 243.422943] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.724Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f21d75165df2914a7f43fbfb","created_at":"2026-10-25T16:27:07.863Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.865Z","job_size_bytes":66,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f21d75165df2914a7f43fbfb: done: 0.022451 sec","job_status":"done","queue_duration_s":1.835983,"scheduling_latency_s":1.835996,"redis_calls":10,"redis_duration_s":0.0033250000000000003,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000376,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002141,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195555,"duration_s":0.022451,"completed_at":"2026-10-25T16:27:09.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2057gitlab # [ 243.486176] gitaly[899]: time="2026-10-25T16:27:09.900Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY diskcache=7f96f660-acf0-437f-b861-2a661074e628 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T22:27:09.890" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.890" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 243.486918] gitaly[899]: time="2026-10-25T16:27:09.901Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-25T22:27:09.890" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.890" grpc.time_ms=10.294 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 243.489429] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.725Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3e44d98fcd5f04d7daaf26da","created_at":"2026-10-25T16:27:07.866Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.869Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3e44d98fcd5f04d7daaf26da: start","job_status":"start","queue_duration_s":1.856127,"scheduling_latency_s":1.85614}2060gitlab # [ 243.504430] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3e44d98fcd5f04d7daaf26da","created_at":"2026-10-25T16:27:07.866Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.869Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3e44d98fcd5f04d7daaf26da: done: 0.025681 sec","job_status":"done","queue_duration_s":1.856127,"scheduling_latency_s":1.85614,"redis_calls":10,"redis_duration_s":0.001266,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210362,"duration_s":0.025681,"completed_at":"2026-10-25T16:27:09.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 243.554787] gitaly[899]: time="2026-10-25T16:27:09.924Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:39.823" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.923" grpc.time_ms=0.401 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 243.556169] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.752Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"dfba3f99d8467f36a73073fc","created_at":"2026-10-25T16:27:07.873Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.876Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-dfba3f99d8467f36a73073fc: start","job_status":"start","queue_duration_s":1.875864,"scheduling_latency_s":1.875876}2063gitlab # [ 243.613148] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.777Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"dfba3f99d8467f36a73073fc","created_at":"2026-10-25T16:27:07.873Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.876Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-dfba3f99d8467f36a73073fc: done: 0.025132 sec","job_status":"done","queue_duration_s":1.875864,"scheduling_latency_s":1.875876,"redis_calls":10,"redis_duration_s":0.001346,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253384,"duration_s":0.025132,"completed_at":"2026-10-25T16:27:09.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2064gitlab # [ 243.654056] gitaly[899]: time="2026-10-25T16:27:09.931Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T16:27:19.265" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:09.925" grpc.time_ms=5.192 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 243.654708] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5b889761bd83f8c4dccfaa97","created_at":"2026-10-25T16:27:07.876Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.879Z","job_size_bytes":6,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5b889761bd83f8c4dccfaa97: start","job_status":"start","queue_duration_s":1.898993,"scheduling_latency_s":1.899008}2066gitlab # [ 243.654992] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.792Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5b889761bd83f8c4dccfaa97","created_at":"2026-10-25T16:27:07.876Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.879Z","job_size_bytes":6,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5b889761bd83f8c4dccfaa97: done: 0.014698 sec","job_status":"done","queue_duration_s":1.898993,"scheduling_latency_s":1.899008,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194159,"duration_s":0.014698,"completed_at":"2026-10-25T16:27:09.792Z","load_balancing_strategy":"primary","db_duration_s":0.00133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 243.706690] gitaly[899]: time="2026-10-25T16:27:09.951Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:39.850" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.950" grpc.time_ms=0.469 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 243.707519] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e075f1764a8bea2fa4cc500e","created_at":"2026-10-25T16:27:07.879Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.882Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e075f1764a8bea2fa4cc500e: start","job_status":"start","queue_duration_s":1.911512,"scheduling_latency_s":1.911525}2069gitlab # [ 243.708165] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e075f1764a8bea2fa4cc500e","created_at":"2026-10-25T16:27:07.879Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.882Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e075f1764a8bea2fa4cc500e: done: 0.024608 sec","job_status":"done","queue_duration_s":1.911512,"scheduling_latency_s":1.911525,"redis_calls":10,"redis_duration_s":0.001275,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213715,"duration_s":0.024608,"completed_at":"2026-10-25T16:27:09.818Z","load_balancing_strategy":"primary","db_duration_s":0.007158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070gitlab # [ 243.746663] gitaly[899]: time="2026-10-25T16:27:09.954Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-25T16:27:39.853" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:09.953" grpc.time_ms=1.262 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd'2072gitlab # [ 243.753817] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.819Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"d051b08b4c4b072890d66ac1","created_at":"2026-10-25T16:27:07.886Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.889Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-d051b08b4c4b072890d66ac1: start","job_status":"start","queue_duration_s":1.929541,"scheduling_latency_s":1.929554}2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd', in 0.03 seconds)2074gitlab # [ 243.798594] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.861Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"d051b08b4c4b072890d66ac1","created_at":"2026-10-25T16:27:07.886Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.889Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-d051b08b4c4b072890d66ac1: done: 0.042361 sec","job_status":"done","queue_duration_s":1.929541,"scheduling_latency_s":1.929554,"redis_calls":14,"redis_duration_s":0.002518,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000705956,"duration_s":0.042361,"completed_at":"2026-10-25T16:27:09.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 243.840853] gitaly[899]: time="2026-10-25T16:27:09.978Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:19.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:09.972" grpc.time_ms=5.316 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 243.841918] nixbot[2634]: {"ts": "2026-10-25T16:27:10.316Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57900 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1\" 200"}2077gitlab # [ 243.842601] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.862Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"57276001fbf893f126a9e0bc","created_at":"2026-10-25T16:27:07.968Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.971Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-57276001fbf893f126a9e0bc: start","job_status":"start","queue_duration_s":1.890813,"scheduling_latency_s":1.890844}2078gitlab # [ 243.843413] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.879Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"57276001fbf893f126a9e0bc","created_at":"2026-10-25T16:27:07.968Z","trace_propagation_headers":{"sentry-trace":"215612d9e76e4da1b236c7275f08a08e-c66f0b40417645a6","baggage":"sentry-trace_id=215612d9e76e4da1b236c7275f08a08e,sentry-release=Unknown"},"correlation_id":"01M5SY4Z5WWFV2VTQDB4N3K512","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:07.971Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-57276001fbf893f126a9e0bc: done: 0.016515 sec","job_status":"done","queue_duration_s":1.890813,"scheduling_latency_s":1.890844,"redis_calls":8,"redis_duration_s":0.0010600000000000002,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016515,"completed_at":"2026-10-25T16:27:09.878Z","load_balancing_strategy":"primary","db_duration_s":0.002548,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2079gitlab # [ 243.882601] gitaly[899]: time="2026-10-25T16:27:10.336Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-25T16:27:40.228" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:10.328" grpc.time_ms=7.716 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 243.922655] nixbot[2634]: {"ts": "2026-10-25T16:27:10.374Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "c2552383-b3cb-4948-b7fc-2340f6e76e5a", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "43b3ea314fe878bc7ebde23450b44215d801b8bd", "pr": null}2081gitlab # [ 243.923498] nixbot[2634]: {"ts": "2026-10-25T16:27:10.376Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57910 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}2082gitlab # [ 243.923997] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.879Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"504240f82086a596ca312114","created_at":"2026-10-25T16:27:08.144Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"190697f54544c3a95efd00b2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.147Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-504240f82086a596ca312114: start","job_status":"start","queue_duration_s":1.732427,"scheduling_latency_s":1.73244}2083gitlab # [ 243.924645] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.909Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"504240f82086a596ca312114","created_at":"2026-10-25T16:27:08.144Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"190697f54544c3a95efd00b2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.147Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-504240f82086a596ca312114: done: 0.029922 sec","job_status":"done","queue_duration_s":1.732427,"scheduling_latency_s":1.73244,"gitaly_calls":1,"gitaly_duration_s":0.012147,"redis_calls":12,"redis_duration_s":0.001575,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000329,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000587,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.019925438,"duration_s":0.029922,"completed_at":"2026-10-25T16:27:09.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2084gitlab # [ 243.975766] gitaly[899]: time="2026-10-25T16:27:10.345Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY665N8QSKWP5FRFRD55SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-25T16:27:40.237" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:10.338" grpc.time_ms=7.531 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 243.976656] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:09.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ec8465d7e619917cab61e124","created_at":"2026-10-25T16:27:08.244Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8503b6fdaa0b3e3499e76d2d88442d1f214f95fb0a78e9c3ff8e44da4e1ef602","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.246Z","job_size_bytes":467,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ec8465d7e619917cab61e124: start","job_status":"start","queue_duration_s":1.664445,"scheduling_latency_s":1.664458}2086gitlab # [ 243.977438] sidekiq-cluster[2511]: {"severity":"WARN","time":"2026-10-25T16:27:10.353Z","class":"CreatePipelineWorker","correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a7af69f448db5c6a4e9bc496ac7aa939a2375cf7","after":"43b3ea314fe878bc7ebde23450b44215d801b8bd","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"43b3ea314fe878bc7ebde23450b44215d801b8bd","ref":"refs/heads/master"},"retry":0}2087gitlab # [ 244.016763] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ec8465d7e619917cab61e124","created_at":"2026-10-25T16:27:08.244Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8503b6fdaa0b3e3499e76d2d88442d1f214f95fb0a78e9c3ff8e44da4e1ef602","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.246Z","job_size_bytes":467,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ec8465d7e619917cab61e124: done: 0.446176 sec","job_status":"done","queue_duration_s":1.664445,"scheduling_latency_s":1.664458,"gitaly_calls":7,"gitaly_duration_s":0.038935,"redis_calls":33,"redis_duration_s":0.002929,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00037,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001344,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.395012,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.446176,"completed_at":"2026-10-25T16:27:10.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010239,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2088gitlab # [ 244.055519] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.358Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7a41b554-6a4d-42e9-8206-3131b06b4010\"}"],"class":"WebHookWorker","jid":"dc829a8d4ec021dcf0eb13f1","created_at":"2026-10-25T16:27:08.260Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1ede4ddb8e386dbe3e8b8ab3b1b0f0e9acd9005ba38f282ee42e28d7e506d96c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.261Z","job_size_bytes":1749,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dc829a8d4ec021dcf0eb13f1: start","job_status":"start","queue_duration_s":2.096476,"scheduling_latency_s":2.096493}2089gitlab # [ 244.056233] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.382Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7a41b554-6a4d-42e9-8206-3131b06b4010\"}"],"class":"WebHookWorker","jid":"dc829a8d4ec021dcf0eb13f1","created_at":"2026-10-25T16:27:08.260Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-ac03a6c1dcf84f0c","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1ede4ddb8e386dbe3e8b8ab3b1b0f0e9acd9005ba38f282ee42e28d7e506d96c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.261Z","job_size_bytes":1749,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dc829a8d4ec021dcf0eb13f1: done: 0.024709 sec","job_status":"done","queue_duration_s":2.096476,"scheduling_latency_s":2.096493,"redis_calls":14,"redis_duration_s":0.001549,"redis_read_bytes":25,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.00028,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.005407112000000325,"cpu_s":0.014541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.024709,"completed_at":"2026-10-25T16:27:10.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001074,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 244.098743] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.383Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"5038b14f96edb08337ce06b2","created_at":"2026-10-25T16:27:08.348Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-05150286bad74fdc","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.351Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-5038b14f96edb08337ce06b2: start","job_status":"start","queue_duration_s":2.03215,"scheduling_latency_s":2.032165}2091gitlab # [ 244.099618] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"5038b14f96edb08337ce06b2","created_at":"2026-10-25T16:27:08.348Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-05150286bad74fdc","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:08.351Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-5038b14f96edb08337ce06b2: done: 0.028514 sec","job_status":"done","queue_duration_s":2.03215,"scheduling_latency_s":2.032165,"redis_calls":19,"redis_duration_s":0.002378,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000309,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004569016,"duration_s":0.028514,"completed_at":"2026-10-25T16:27:10.412Z","load_balancing_strategy":"primary","db_duration_s":0.004373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 244.137503] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.413Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a07f2ce425e9f5fe9827f1cc"],"class":"WebHooks::LogExecutionWorker","jid":"257c67c7fdf5f763107e8d16","created_at":"2026-10-25T16:27:09.335Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-8f4ff4bd79e14861","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0f6bec52050a97acd003db9baae206e91770145c9d90e1311ae1f1f2f5d5369f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:09.343Z","job_size_bytes":2593,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-257c67c7fdf5f763107e8d16: start","job_status":"start","queue_duration_s":1.069746,"scheduling_latency_s":1.06976}2093gitlab # [ 244.145624] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.444Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","a07f2ce425e9f5fe9827f1cc"],"class":"WebHooks::LogExecutionWorker","jid":"257c67c7fdf5f763107e8d16","created_at":"2026-10-25T16:27:09.335Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-8f4ff4bd79e14861","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0f6bec52050a97acd003db9baae206e91770145c9d90e1311ae1f1f2f5d5369f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:09.343Z","job_size_bytes":2593,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-257c67c7fdf5f763107e8d16: done: 0.0316 sec","job_status":"done","queue_duration_s":1.069746,"scheduling_latency_s":1.06976,"redis_calls":10,"redis_duration_s":0.00161,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276292,"duration_s":0.0316,"completed_at":"2026-10-25T16:27:10.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 244.184132] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.446Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dc829a8d4ec021dcf0eb13f1"],"class":"WebHooks::LogExecutionWorker","jid":"49e9c14289dcca99bf55c31a","created_at":"2026-10-25T16:27:10.378Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-680e471ffeaf4d34","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6aec9130f507bbdd969049c7a4a85258bb995a2fa2f9b2678968bb56732315f9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:10.379Z","job_size_bytes":2592,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-49e9c14289dcca99bf55c31a: start","job_status":"start","queue_duration_s":0.066721,"scheduling_latency_s":0.066735}2095gitlab # [ 244.234228] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.463Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dc829a8d4ec021dcf0eb13f1"],"class":"WebHooks::LogExecutionWorker","jid":"49e9c14289dcca99bf55c31a","created_at":"2026-10-25T16:27:10.378Z","trace_propagation_headers":{"sentry-trace":"25d3acb902b245e0941971e8c44bae6a-680e471ffeaf4d34","baggage":"sentry-trace_id=25d3acb902b245e0941971e8c44bae6a,sentry-release=Unknown"},"correlation_id":"01M5SY665N8QSKWP5FRFRD55SY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6aec9130f507bbdd969049c7a4a85258bb995a2fa2f9b2678968bb56732315f9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:10.379Z","job_size_bytes":2592,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-49e9c14289dcca99bf55c31a: done: 0.017496 sec","job_status":"done","queue_duration_s":0.066721,"scheduling_latency_s":0.066735,"redis_calls":7,"redis_duration_s":0.001372,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017496,"completed_at":"2026-10-25T16:27:10.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 244.236136] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.465Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"89068d0b5cf4bc3ae7dea7f5","created_at":"2026-10-25T16:27:10.404Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-ddaa8347f12645aa","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:10.407Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-89068d0b5cf4bc3ae7dea7f5: start","job_status":"start","queue_duration_s":0.057824,"scheduling_latency_s":0.057838}2097gitlab # [ 244.275221] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:10.528Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"89068d0b5cf4bc3ae7dea7f5","created_at":"2026-10-25T16:27:10.404Z","trace_propagation_headers":{"sentry-trace":"4ce3aae0ccfd42de93e34c530d78edca-ddaa8347f12645aa","baggage":"sentry-trace_id=4ce3aae0ccfd42de93e34c530d78edca,sentry-release=Unknown"},"correlation_id":"01M5SY4TX5WT3EDQVCW2JFHWE2","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:10.407Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-89068d0b5cf4bc3ae7dea7f5: done: 0.063456 sec","job_status":"done","queue_duration_s":0.057824,"scheduling_latency_s":0.057838,"redis_calls":11,"redis_duration_s":0.002576,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001538,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285231,"duration_s":0.063456,"completed_at":"2026-10-25T16:27:10.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 244.358715] nixbot[2634]: {"ts": "2026-10-25T16:27:10.855Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2099gitlab # [ 244.361750] nixbot[2634]: {"ts": "2026-10-25T16:27:10.858Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "a7af69f448db5c6a4e9bc496ac7aa939a2375cf7"}2100gitlab # [ 244.411227] gitaly[899]: time="2026-10-25T16:27:10.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BM93G4SFA4MD5WNAQEC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:10.901" grpc.time_ms=5.97 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2101gitlab # [ 244.411899] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 502102gitlab # [ 244.423446] gitaly[899]: time="2026-10-25T16:27:10.919Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:40.618" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:10.919" grpc.time_ms=0.631 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 244.452740] gitaly[899]: time="2026-10-25T16:27:10.949Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BNXH0EEGWAD61MHM96T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:10.943" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2104gitlab # [ 244.453191] gitaly[899]: time="2026-10-25T16:27:10.949Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BNXH0EEGWAD61MHM96T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:10.943" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2105gitlab # [ 244.453915] gitaly[899]: time="2026-10-25T16:27:10.949Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BNXH0EEGWAD61MHM96T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:10.943" grpc.time_ms=6.294 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2106gitlab # [ 244.454503] gitlab-workhorse[822]: time="2026-10-25T16:27:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672107gitlab # [ 244.454972] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 412108gitlab # [ 244.503956] gitaly[899]: time="2026-10-25T16:27:11.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:20.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:10.995" grpc.time_ms=5.102 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 244.545267] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.040Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3b53d9ddf9672288f24c76de","created_at":"2026-10-25T16:27:11.035Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-b0a6f08dabf84343","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.038Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3b53d9ddf9672288f24c76de: start","job_status":"start","queue_duration_s":0.002535,"scheduling_latency_s":0.002562}2110gitlab # [ 244.554940] gitaly[899]: time="2026-10-25T16:27:11.050Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BS2BSK5SKF64BC3514Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.043" grpc.time_ms=7.211 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2111gitlab # [ 244.555678] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1772112gitlab # [ 244.558695] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442113gitlab # [ 244.596055] gitaly[899]: time="2026-10-25T16:27:11.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BTGP278X9EF3XD5C4YS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:41.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.090" grpc.time_ms=0.448 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 244.610664] gitaly[899]: time="2026-10-25T16:27:11.107Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BTM2QB2SAJJAV2MVSSS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.096" pid=899 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2115gitlab # [ 244.611105] gitaly[899]: time="2026-10-25T16:27:11.107Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BTM2QB2SAJJAV2MVSSS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.096" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2116gitlab # [ 244.611572] gitaly[899]: time="2026-10-25T16:27:11.107Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BTM2QB2SAJJAV2MVSSS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.096" grpc.time_ms=10.507 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2117gitlab # [ 244.612157] gitlab-workhorse[822]: time="2026-10-25T16:27:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212118gitlab # [ 244.612625] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 472119gitlab # [ 244.626093] gitaly[899]: time="2026-10-25T16:27:11.121Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.120" grpc.time_ms=0.594 pid=899 span.kind=server system=grpc2120gitlab # [ 244.636091] gitaly[899]: time="2026-10-25T16:27:11.132Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BTGP278X9EF3XD5C4YS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:21.107" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.128" grpc.time_ms=4.409 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 244.666303] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1062122gitlab # [ 244.700387] gitaly[899]: time="2026-10-25T16:27:11.193Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.193" grpc.time_ms=0.286 pid=899 span.kind=server system=grpc2123gitlab # [ 244.719871] gitaly[899]: time="2026-10-25T16:27:11.216Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BXZGRFXZGC8JTEYKQ8A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:41.015" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.215" grpc.time_ms=0.404 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 244.724416] gitaly[899]: time="2026-10-25T16:27:11.220Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.220" grpc.time_ms=0.227 pid=899 span.kind=server system=grpc2125gitlab # [ 244.732920] gitaly[899]: time="2026-10-25T16:27:11.229Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:41.028" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.228" grpc.time_ms=0.385 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 244.743985] gitaly[899]: time="2026-10-25T16:27:11.240Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-25T16:27:41.034" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.235" grpc.time_ms=5.26 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 244.752952] gitaly[899]: time="2026-10-25T16:27:11.249Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:21.224" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.244" grpc.time_ms=4.71 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 244.772402] gitaly[899]: time="2026-10-25T16:27:11.268Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-25T16:27:21.247" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:11.268" grpc.time_ms=0.312 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 244.781156] gitaly[899]: time="2026-10-25T16:27:11.276Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-25T16:27:21.251" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.272" grpc.time_ms=4.298 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 244.809411] gitaly[899]: time="2026-10-25T16:27:11.305Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END diskcache=026fdf78-45b7-4b49-8a30-6d8313304e3c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.092" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.093" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd'2132gitlab # [ 244.809750] gitaly[899]: time="2026-10-25T16:27:11.305Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=175 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7168 command.oublock=0 command.real_time_ms=206 command.spawn_token_fork_ms=1 command.system_time_ms=149 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.092" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.093" grpc.time_ms=212.577 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 244.810482] gitaly[899]: time="2026-10-25T16:27:11.306Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.305" grpc.time_ms=0.377 pid=899 span.kind=server system=grpc2134gitlab # [ 244.834346] gitaly[899]: time="2026-10-25T16:27:11.330Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BXZGRFXZGC8JTEYKQ8A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:21.125" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.325" grpc.time_ms=4.614 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2135gitlab # [ 244.869537] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a7af69f448db5c6a4e9bc496ac7aa939a2375cf7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1982136gitlab # [ 244.878259] gitaly[899]: time="2026-10-25T16:27:11.374Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.373" grpc.time_ms=0.694 pid=899 span.kind=server system=grpc2137gitlab # [ 244.890296] nixbot[2634]: {"ts": "2026-10-25T16:27:11.386Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:57926 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1\" 200"}2138gitlab # [ 244.892746] gitaly[899]: time="2026-10-25T16:27:11.389Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:41.288" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.388" grpc.time_ms=0.515 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 244.898288] gitaly[899]: time="2026-10-25T16:27:11.393Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ diskcache=8a369a49-b2af-47b8-9025-0b4331cfd801 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T16:27:21.257" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:11.278" pid=899 ref=refs/keep-around/43b3ea314fe878bc7ebde23450b44215d801b8bd remote_ip="2001:db8:1::1" revision=43b3ea314fe878bc7ebde23450b44215d801b8bd span.kind=server system=grpc username=root2140gitlab # [ 244.898962] gitaly[899]: time="2026-10-25T16:27:11.393Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5604 command.oublock=8 command.real_time_ms=107 command.spawn_token_fork_ms=0 command.system_time_ms=51 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-25T16:27:21.257" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-25T16:27:11.278" grpc.time_ms=115.626 pid=899 ref=refs/keep-around/43b3ea314fe878bc7ebde23450b44215d801b8bd remote_ip="2001:db8:1::1" revision=43b3ea314fe878bc7ebde23450b44215d801b8bd span.kind=server system=grpc username=root2141gitlab # [ 244.902356] gitaly[899]: time="2026-10-25T16:27:11.398Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:41.197" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.397" grpc.time_ms=0.686 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=43b3ea314fe878bc7ebde23450b44215d801b8bd', in 0.12 seconds)2143(finished: subtest: push delivers the webhook, in 46.74 seconds)2144subtest: eval and build post commit statuses2145gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2146gitlab # [ 244.944696] gitaly[899]: time="2026-10-25T16:27:11.440Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6C57A1AXW7A3X2ZGG7A9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.431" grpc.time_ms=8.923 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2147gitlab # [ 244.956321] gitaly[899]: time="2026-10-25T16:27:11.448Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:41.346" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.446" grpc.time_ms=1.216 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 244.967203] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 412149gitlab # [ 244.969196] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.461Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a5505aa698f910804b7f854a","created_at":"2026-10-25T16:27:11.457Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"3b53d9ddf9672288f24c76de","job_size_bytes":3,"pid":2511,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a5505aa698f910804b7f854a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2150gitlab # [ 244.982545] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.462Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3b53d9ddf9672288f24c76de","created_at":"2026-10-25T16:27:11.035Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-b0a6f08dabf84343","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.038Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2511,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3b53d9ddf9672288f24c76de: rescheduled"}2151gitlab # [ 244.995630] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.468Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3b53d9ddf9672288f24c76de","created_at":"2026-10-25T16:27:11.035Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-b0a6f08dabf84343","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.038Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3b53d9ddf9672288f24c76de: done: 0.428494 sec","job_status":"done","queue_duration_s":0.002535,"scheduling_latency_s":0.002562,"gitaly_calls":3,"gitaly_duration_s":0.265066,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013553,"redis_read_bytes":226,"redis_write_bytes":18467,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000801,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000598,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003545,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005929,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000162,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000422,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086578,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3883745,"duration_s":0.428494,"completed_at":"2026-10-25T16:27:11.468Z","load_balancing_strategy":"primary","db_duration_s":0.060564,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2152gitlab # [ 245.039966] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"48057306db7d75b5fee2828a","created_at":"2026-10-25T16:27:11.087Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.088Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-48057306db7d75b5fee2828a: start","job_status":"start","queue_duration_s":0.381194,"scheduling_latency_s":0.381213}2153gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.14 seconds)2154gitlab # [ 245.054724] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.508Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"48057306db7d75b5fee2828a","created_at":"2026-10-25T16:27:11.087Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.088Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-48057306db7d75b5fee2828a: done: 0.038846 sec","job_status":"done","queue_duration_s":0.381194,"scheduling_latency_s":0.381213,"redis_calls":7,"redis_duration_s":0.002353,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002028,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000325,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038846,"completed_at":"2026-10-25T16:27:11.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009961,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2155gitlab # [ 245.094735] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.510Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"238ba3b3fa84c5302616c70f","created_at":"2026-10-25T16:27:11.355Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.357Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-238ba3b3fa84c5302616c70f: start","job_status":"start","queue_duration_s":0.153852,"scheduling_latency_s":0.153872}2156gitlab # [ 245.111131] gitaly[899]: time="2026-10-25T16:27:11.492Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6C6KYN4GK63R3Q4JC5JP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.485" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2157gitlab # [ 245.120181] gitlab-workhorse[822]: time="2026-10-25T16:27:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672158gitlab # [ 245.121954] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 492159gitlab # [ 245.123844] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3202160gitlab # [ 245.126287] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1202161gitlab # [ 245.128684] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 782162gitlab # [ 245.130676] nixbot[2634]: {"ts": "2026-10-25T16:27:11.553Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-43b3ea314fe8-4"}2163gitlab # [ 245.132875] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.539Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"238ba3b3fa84c5302616c70f","created_at":"2026-10-25T16:27:11.355Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.357Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-238ba3b3fa84c5302616c70f: done: 0.028689 sec","job_status":"done","queue_duration_s":0.153852,"scheduling_latency_s":0.153872,"redis_calls":7,"redis_duration_s":0.0031260000000000003,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028689,"completed_at":"2026-10-25T16:27:11.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2164gitlab # [ 245.170685] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c5c783aca1c11ee78b5550fa","created_at":"2026-10-25T16:27:11.362Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.364Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c5c783aca1c11ee78b5550fa: start","job_status":"start","queue_duration_s":0.176615,"scheduling_latency_s":0.176635}2165gitlab # [ 245.170889] gitaly[899]: time="2026-10-25T16:27:11.492Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6C6KYN4GK63R3Q4JC5JP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.485" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2166gitlab # [ 245.171501] nixbot[2634]: {"ts": "2026-10-25T16:27:11.658Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-43b3ea314fe8-4", "argv0": "bwrap"}2167gitlab # [ 245.171976] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c5c783aca1c11ee78b5550fa","created_at":"2026-10-25T16:27:11.362Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.364Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c5c783aca1c11ee78b5550fa: done: 0.033358 sec","job_status":"done","queue_duration_s":0.176615,"scheduling_latency_s":0.176635,"redis_calls":7,"redis_duration_s":0.004128,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033358,"completed_at":"2026-10-25T16:27:11.574Z","load_balancing_strategy":"primary","db_duration_s":0.012295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2168gitlab # [ 245.217991] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"dae2cfe32e2c2a155b1624cd","created_at":"2026-10-25T16:27:11.370Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.371Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dae2cfe32e2c2a155b1624cd: start","job_status":"start","queue_duration_s":0.206855,"scheduling_latency_s":0.206871}2169gitlab # [ 245.218720] gitlab-workhorse[822]: time="2026-10-25T16:27:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672170gitlab # [ 245.218828] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 572171gitlab # [ 245.219442] gitaly[899]: time="2026-10-25T16:27:11.492Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6C6KYN4GK63R3Q4JC5JP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.485" grpc.time_ms=7.136 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2172gitlab # [ 245.224985] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"dae2cfe32e2c2a155b1624cd","created_at":"2026-10-25T16:27:11.370Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.371Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dae2cfe32e2c2a155b1624cd: done: 0.030077 sec","job_status":"done","queue_duration_s":0.206855,"scheduling_latency_s":0.206871,"redis_calls":10,"redis_duration_s":0.002164,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001118,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030077,"completed_at":"2026-10-25T16:27:11.608Z","load_balancing_strategy":"primary","db_duration_s":0.004155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2173gitlab # [ 245.266439] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.609Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"aedd0a27636724c2af3a4ac1","created_at":"2026-10-25T16:27:11.371Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.372Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-aedd0a27636724c2af3a4ac1: start","job_status":"start","queue_duration_s":0.236662,"scheduling_latency_s":0.236678}2174gitlab # [ 245.277581] gitaly[899]: time="2026-10-25T16:27:11.532Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6C70NENXJFH0STRBEXNR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:41.331" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:11.532" grpc.time_ms=0.528 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 245.288894] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"aedd0a27636724c2af3a4ac1","created_at":"2026-10-25T16:27:11.371Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.372Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-aedd0a27636724c2af3a4ac1: done: 0.021272 sec","job_status":"done","queue_duration_s":0.236662,"scheduling_latency_s":0.236678,"redis_calls":7,"redis_duration_s":0.001037,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000347,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021272,"completed_at":"2026-10-25T16:27:11.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2176gitlab # [ 245.333645] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d095f523f381a8b4fa4c662c","created_at":"2026-10-25T16:27:11.373Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.374Z","job_size_bytes":19,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d095f523f381a8b4fa4c662c: start","job_status":"start","queue_duration_s":0.256794,"scheduling_latency_s":0.256809}2177gitlab # [ 245.371957] gitaly[899]: time="2026-10-25T16:27:11.597Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6C8Z6XC980GDA3Z1YXA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.587" grpc.time_ms=10.248 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2178gitlab # [ 245.372582] gitaly[899]: time="2026-10-25T16:27:11.655Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6CBF299WKKA7YBH1GZFA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.648" pid=899 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2179gitlab # [ 245.373258] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.650Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d095f523f381a8b4fa4c662c","created_at":"2026-10-25T16:27:11.373Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.374Z","job_size_bytes":19,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d095f523f381a8b4fa4c662c: done: 0.018284 sec","job_status":"done","queue_duration_s":0.256794,"scheduling_latency_s":0.256809,"redis_calls":8,"redis_duration_s":0.001216,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018284,"completed_at":"2026-10-25T16:27:11.650Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 245.398691] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.651Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"59930f61a743b71d269bc372","created_at":"2026-10-25T16:27:11.375Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.377Z","job_size_bytes":66,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-59930f61a743b71d269bc372: start","job_status":"start","queue_duration_s":0.274164,"scheduling_latency_s":0.274182}2181gitlab # [ 245.448110] gitaly[899]: time="2026-10-25T16:27:11.655Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6CBF299WKKA7YBH1GZFA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.648" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab # [ 245.448745] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.670Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"59930f61a743b71d269bc372","created_at":"2026-10-25T16:27:11.375Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.377Z","job_size_bytes":66,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-59930f61a743b71d269bc372: done: 0.019411 sec","job_status":"done","queue_duration_s":0.274164,"scheduling_latency_s":0.274182,"redis_calls":7,"redis_duration_s":0.001008,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019411,"completed_at":"2026-10-25T16:27:11.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 245.492132] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.748Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4d5ee7808ea8ef93f0ec62aa","created_at":"2026-10-25T16:27:11.377Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.378Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4d5ee7808ea8ef93f0ec62aa: start","job_status":"start","queue_duration_s":0.369621,"scheduling_latency_s":0.369644}2184gitlab # [ 245.492702] gitaly[899]: time="2026-10-25T16:27:11.656Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6CBF299WKKA7YBH1GZFA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:11.648" grpc.time_ms=7.724 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2185gitlab # [ 245.493524] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.768Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4d5ee7808ea8ef93f0ec62aa","created_at":"2026-10-25T16:27:11.377Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.378Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4d5ee7808ea8ef93f0ec62aa: done: 0.020099 sec","job_status":"done","queue_duration_s":0.369621,"scheduling_latency_s":0.369644,"redis_calls":7,"redis_duration_s":0.0009580000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020099,"completed_at":"2026-10-25T16:27:11.768Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 245.533160] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.768Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b60062f8f837fedcf1ebf7b9","created_at":"2026-10-25T16:27:11.378Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.379Z","job_size_bytes":6,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b60062f8f837fedcf1ebf7b9: start","job_status":"start","queue_duration_s":0.389413,"scheduling_latency_s":0.389426}2187gitlab # [ 245.542634] gitaly[899]: time="2026-10-25T16:27:11.902Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.902" grpc.time_ms=0.31 pid=899 span.kind=server system=grpc2188gitlab # [ 245.551459] gitaly[899]: time="2026-10-25T16:27:11.985Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:11.920" grpc.time_ms=65.541 pid=899 span.kind=server system=grpc2189gitlab # [ 245.559752] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.777Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b60062f8f837fedcf1ebf7b9","created_at":"2026-10-25T16:27:11.378Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.379Z","job_size_bytes":6,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b60062f8f837fedcf1ebf7b9: done: 0.008564 sec","job_status":"done","queue_duration_s":0.389413,"scheduling_latency_s":0.389426,"redis_calls":7,"redis_duration_s":0.000865,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008564,"completed_at":"2026-10-25T16:27:11.777Z","load_balancing_strategy":"primary","db_duration_s":0.000265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2190gitlab # [ 245.609316] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b61340d0b7727c1b93d082e7","created_at":"2026-10-25T16:27:11.379Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.380Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b61340d0b7727c1b93d082e7: start","job_status":"start","queue_duration_s":0.39768,"scheduling_latency_s":0.397693}2191gitlab # [ 245.610426] gitaly[899]: time="2026-10-25T16:27:12.005Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:12.004" grpc.time_ms=0.248 pid=899 span.kind=server system=grpc2192gitlab # [ 245.618782] gitaly[899]: time="2026-10-25T16:27:12.007Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.783" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.884" operations="[repack_refs]" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 245.660522] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.791Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"b61340d0b7727c1b93d082e7","created_at":"2026-10-25T16:27:11.379Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.380Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-b61340d0b7727c1b93d082e7: done: 0.013654 sec","job_status":"done","queue_duration_s":0.39768,"scheduling_latency_s":0.397693,"redis_calls":7,"redis_duration_s":0.0008600000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013654,"completed_at":"2026-10-25T16:27:11.791Z","load_balancing_strategy":"primary","db_duration_s":0.001958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2194gitlab # [ 245.663658] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.792Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ad373f6f4f5d0ebd60b13e82","created_at":"2026-10-25T16:27:11.401Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-e85f446e751b4c05","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.404Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ad373f6f4f5d0ebd60b13e82: start","job_status":"start","queue_duration_s":0.38801,"scheduling_latency_s":0.388023}2195gitlab # [ 245.706511] gitaly[899]: time="2026-10-25T16:27:12.009Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.783" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.884" pid=899 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-25 16:26:13.962342539 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2196gitlab # [ 245.707227] gitaly[899]: time="2026-10-25T16:27:12.013Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END diskcache=02467062-1ea8-491c-aa0c-41008787da90 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.783" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.884" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 245.707842] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.809Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ad373f6f4f5d0ebd60b13e82","created_at":"2026-10-25T16:27:11.401Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-e85f446e751b4c05","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.404Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ad373f6f4f5d0ebd60b13e82: done: 0.016972 sec","job_status":"done","queue_duration_s":0.38801,"scheduling_latency_s":0.388023,"redis_calls":7,"redis_duration_s":0.0009,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016972,"completed_at":"2026-10-25T16:27:11.809Z","load_balancing_strategy":"primary","db_duration_s":0.002623,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2198gitlab # [ 245.765723] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.810Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3e5ab9bd5257e65bbca9404e","created_at":"2026-10-25T16:27:11.405Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-e85f446e751b4c05","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.407Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3e5ab9bd5257e65bbca9404e: start","job_status":"start","queue_duration_s":0.403163,"scheduling_latency_s":0.403176}2199gitlab # [ 245.766531] gitaly[899]: time="2026-10-25T16:27:12.014Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7770 command.oublock=0 command.real_time_ms=124 command.spawn_token_fork_ms=1 command.system_time_ms=43 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.783" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.884" grpc.time_ms=129.754 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 245.767221] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.841Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3e5ab9bd5257e65bbca9404e","created_at":"2026-10-25T16:27:11.405Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-e85f446e751b4c05","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.407Z","job_size_bytes":65,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3e5ab9bd5257e65bbca9404e: done: 0.030512 sec","job_status":"done","queue_duration_s":0.403163,"scheduling_latency_s":0.403176,"redis_calls":10,"redis_duration_s":0.001531,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030512,"completed_at":"2026-10-25T16:27:11.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2201gitlab # [ 245.807659] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:11.842Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2be9a6896f9a7313f96fed94","created_at":"2026-10-25T16:27:11.463Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.464Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2be9a6896f9a7313f96fed94: start","job_status":"start","queue_duration_s":0.377319,"scheduling_latency_s":0.377333}2202gitlab # [ 245.847070] gitaly[899]: time="2026-10-25T16:27:12.021Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.783" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.884" pid=899 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2203gitlab # [ 245.847700] gitaly[899]: time="2026-10-25T16:27:12.021Z" level=info msg="optimized repository" clean_stale_data_time=11.764903ms clean_work_trees_time="81.016µs" commit_graph_time="3.632µs" correlation_id=01M5SY6BMS47EYPK0ACTQC1END gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.191µs" pid=899 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.19µs" storage_name=default system=housekeeping total_time=11.953754ms2204gitlab # [ 245.848244] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.075Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2be9a6896f9a7313f96fed94","created_at":"2026-10-25T16:27:11.463Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-5b733936cde14062","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.464Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2be9a6896f9a7313f96fed94: done: 0.233384 sec","job_status":"done","queue_duration_s":0.377319,"scheduling_latency_s":0.377333,"gitaly_calls":3,"gitaly_duration_s":0.135288,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007467,"redis_read_bytes":142,"redis_write_bytes":16718,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000332,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000618,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001641,"redis_queues_read_bytes":22,"redis_queues_write_bytes":11224,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002594,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000142,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000736,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076132,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.212451303,"duration_s":0.233384,"completed_at":"2026-10-25T16:27:12.075Z","load_balancing_strategy":"primary","db_duration_s":0.018961,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2205gitlab # [ 245.888889] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.076Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dcd15ecf82ecf09c27535b40","created_at":"2026-10-25T16:27:11.490Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-e85f446e751b4c05","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.496Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dcd15ecf82ecf09c27535b40: start","job_status":"start","queue_duration_s":0.580322,"scheduling_latency_s":0.580336}2206gitlab # [ 245.889685] gitaly[899]: time="2026-10-25T16:27:12.021Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:41.783" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:11.884" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 245.896763] gitaly[899]: time="2026-10-25T16:27:12.050Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:42.049" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:12.049" grpc.time_ms=0.488 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 245.908093] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.151Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"dcd15ecf82ecf09c27535b40","created_at":"2026-10-25T16:27:11.490Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-e85f446e751b4c05","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.496Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-dcd15ecf82ecf09c27535b40: done: 0.074554 sec","job_status":"done","queue_duration_s":0.580322,"scheduling_latency_s":0.580336,"gitaly_calls":2,"gitaly_duration_s":0.003911,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004125,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00066,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000653,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000175,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000141,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000257,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054078,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.056930141,"duration_s":0.074554,"completed_at":"2026-10-25T16:27:12.150Z","load_balancing_strategy":"primary","db_duration_s":0.015955,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2209gitlab # [ 245.953566] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"61842e1d1370273632337b08","created_at":"2026-10-25T16:27:11.879Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.880Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-61842e1d1370273632337b08: start","job_status":"start","queue_duration_s":0.271235,"scheduling_latency_s":0.27125}2210gitlab # [ 245.967918] gitaly[899]: time="2026-10-25T16:27:12.068Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BMS47EYPK0ACTQC1END grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:42.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:12.067" grpc.time_ms=0.425 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2211gitlab # [ 246.006693] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.175Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"61842e1d1370273632337b08","created_at":"2026-10-25T16:27:11.879Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:11.880Z","job_size_bytes":23,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-61842e1d1370273632337b08: done: 0.023448 sec","job_status":"done","queue_duration_s":0.271235,"scheduling_latency_s":0.27125,"redis_calls":7,"redis_duration_s":0.000862,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023448,"completed_at":"2026-10-25T16:27:12.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004065,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2212gitlab # [ 246.050276] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.176Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbd708ffa3d26084ec6be4ed","created_at":"2026-10-25T16:27:12.018Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.020Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbd708ffa3d26084ec6be4ed: start","job_status":"start","queue_duration_s":0.156243,"scheduling_latency_s":0.156257}2213gitlab # [ 246.050995] gitaly[899]: time="2026-10-25T16:27:12.123Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:42.022" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:12.123" grpc.time_ms=0.6 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2215gitlab # [ 246.051644] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.191Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbd708ffa3d26084ec6be4ed","created_at":"2026-10-25T16:27:12.018Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.020Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbd708ffa3d26084ec6be4ed: done: 0.015133 sec","job_status":"done","queue_duration_s":0.156243,"scheduling_latency_s":0.156257,"redis_calls":7,"redis_duration_s":0.000837,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015133,"completed_at":"2026-10-25T16:27:12.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 246.092568] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.192Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6014cb1ab913c186ca484419","created_at":"2026-10-25T16:27:12.024Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.026Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6014cb1ab913c186ca484419: start","job_status":"start","queue_duration_s":0.165573,"scheduling_latency_s":0.165587}2217gitlab # [ 246.093387] gitaly[899]: time="2026-10-25T16:27:12.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6BYNS0ZC9ZH682Q358ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:42.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:12.143" grpc.time_ms=0.372 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2218gitlab # [ 246.135290] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.208Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6014cb1ab913c186ca484419","created_at":"2026-10-25T16:27:12.024Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.026Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6014cb1ab913c186ca484419: done: 0.016331 sec","job_status":"done","queue_duration_s":0.165573,"scheduling_latency_s":0.165587,"redis_calls":7,"redis_duration_s":0.000918,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016331,"completed_at":"2026-10-25T16:27:12.208Z","load_balancing_strategy":"primary","db_duration_s":0.003225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 246.138191] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9ca968eb9f3bb15bbd1f499b","created_at":"2026-10-25T16:27:12.033Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.034Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9ca968eb9f3bb15bbd1f499b: start","job_status":"start","queue_duration_s":0.174857,"scheduling_latency_s":0.174871}2220gitlab # [ 246.151986] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.226Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9ca968eb9f3bb15bbd1f499b","created_at":"2026-10-25T16:27:12.033Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.034Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9ca968eb9f3bb15bbd1f499b: done: 0.01709 sec","job_status":"done","queue_duration_s":0.174857,"scheduling_latency_s":0.174871,"redis_calls":10,"redis_duration_s":0.001219,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000339,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01709,"completed_at":"2026-10-25T16:27:12.226Z","load_balancing_strategy":"primary","db_duration_s":0.002551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 246.193726] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.227Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1ba95fbed7decdad300b1ca4","created_at":"2026-10-25T16:27:12.034Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.035Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1ba95fbed7decdad300b1ca4: start","job_status":"start","queue_duration_s":0.191539,"scheduling_latency_s":0.191553}2222gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.17 seconds)2223gitlab # [ 246.204189] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.243Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1ba95fbed7decdad300b1ca4","created_at":"2026-10-25T16:27:12.034Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.035Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1ba95fbed7decdad300b1ca4: done: 0.016429 sec","job_status":"done","queue_duration_s":0.191539,"scheduling_latency_s":0.191553,"redis_calls":7,"redis_duration_s":0.001169,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016429,"completed_at":"2026-10-25T16:27:12.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 246.243702] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.244Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"860d2aa325aea1201bca0402","created_at":"2026-10-25T16:27:12.036Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.037Z","job_size_bytes":19,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-860d2aa325aea1201bca0402: start","job_status":"start","queue_duration_s":0.207514,"scheduling_latency_s":0.207534}2225gitlab # [ 246.256118] gitaly[899]: time="2026-10-25T16:27:12.730Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6DBPC136W34ZW42YKYGZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:42.429" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:12.730" grpc.time_ms=0.51 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 246.267380] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1162227gitlab # [ 246.306245] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.260Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"860d2aa325aea1201bca0402","created_at":"2026-10-25T16:27:12.036Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.037Z","job_size_bytes":19,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-860d2aa325aea1201bca0402: done: 0.015472 sec","job_status":"done","queue_duration_s":0.207514,"scheduling_latency_s":0.207534,"redis_calls":8,"redis_duration_s":0.000989,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015472,"completed_at":"2026-10-25T16:27:12.260Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 246.307408] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.261Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dbe5a9b896167df88294180d","created_at":"2026-10-25T16:27:12.038Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.039Z","job_size_bytes":66,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dbe5a9b896167df88294180d: start","job_status":"start","queue_duration_s":0.222111,"scheduling_latency_s":0.222124}2229gitlab # [ 246.321650] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.273Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dbe5a9b896167df88294180d","created_at":"2026-10-25T16:27:12.038Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.039Z","job_size_bytes":66,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dbe5a9b896167df88294180d: done: 0.012744 sec","job_status":"done","queue_duration_s":0.222111,"scheduling_latency_s":0.222124,"redis_calls":7,"redis_duration_s":0.000891,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012744,"completed_at":"2026-10-25T16:27:12.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 246.360569] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.274Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c2481f5558f092559b87e558","created_at":"2026-10-25T16:27:12.039Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.040Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c2481f5558f092559b87e558: start","job_status":"start","queue_duration_s":0.234543,"scheduling_latency_s":0.234556}2231gitlab # [ 246.401621] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.290Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c2481f5558f092559b87e558","created_at":"2026-10-25T16:27:12.039Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.040Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c2481f5558f092559b87e558: done: 0.015354 sec","job_status":"done","queue_duration_s":0.234543,"scheduling_latency_s":0.234556,"redis_calls":7,"redis_duration_s":0.001065,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015354,"completed_at":"2026-10-25T16:27:12.290Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 246.409992] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.291Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1665ea8024b2172e832ac4f3","created_at":"2026-10-25T16:27:12.040Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.041Z","job_size_bytes":6,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1665ea8024b2172e832ac4f3: start","job_status":"start","queue_duration_s":0.249499,"scheduling_latency_s":0.249513}2233gitlab # [ 246.449294] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1665ea8024b2172e832ac4f3","created_at":"2026-10-25T16:27:12.040Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.041Z","job_size_bytes":6,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1665ea8024b2172e832ac4f3: done: 0.008084 sec","job_status":"done","queue_duration_s":0.249499,"scheduling_latency_s":0.249513,"redis_calls":7,"redis_duration_s":0.0008500000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008084,"completed_at":"2026-10-25T16:27:12.299Z","load_balancing_strategy":"primary","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 246.460597] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"447b130595f8c3ad43d401a6","created_at":"2026-10-25T16:27:12.041Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.042Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-447b130595f8c3ad43d401a6: start","job_status":"start","queue_duration_s":0.257303,"scheduling_latency_s":0.257316}2235gitlab # [ 246.502290] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.312Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"447b130595f8c3ad43d401a6","created_at":"2026-10-25T16:27:12.041Z","trace_propagation_headers":{"sentry-trace":"1c087cefaffc4b86bf56ba90f4531163-d6d9d66d83994407","baggage":"sentry-trace_id=1c087cefaffc4b86bf56ba90f4531163,sentry-release=Unknown"},"correlation_id":"01M5SY6BMS47EYPK0ACTQC1END","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.042Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-447b130595f8c3ad43d401a6: done: 0.012802 sec","job_status":"done","queue_duration_s":0.257303,"scheduling_latency_s":0.257316,"redis_calls":7,"redis_duration_s":0.000869,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012802,"completed_at":"2026-10-25T16:27:12.312Z","load_balancing_strategy":"primary","db_duration_s":0.001762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 246.543128] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.313Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"00d3d67e7720deb26c29419d","created_at":"2026-10-25T16:27:12.112Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-808ac1e44afa4677","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.114Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-00d3d67e7720deb26c29419d: start","job_status":"start","queue_duration_s":0.199487,"scheduling_latency_s":0.199499}2237gitlab # [ 246.543836] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:12.332Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"00d3d67e7720deb26c29419d","created_at":"2026-10-25T16:27:12.112Z","trace_propagation_headers":{"sentry-trace":"b3f972c4802d4e06b49f2e5c9b9b56d1-808ac1e44afa4677","baggage":"sentry-trace_id=b3f972c4802d4e06b49f2e5c9b9b56d1,sentry-release=Unknown"},"correlation_id":"01M5SY6BYNS0ZC9ZH682Q358ZZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:12.114Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-00d3d67e7720deb26c29419d: done: 0.018562 sec","job_status":"done","queue_duration_s":0.199487,"scheduling_latency_s":0.199499,"redis_calls":7,"redis_duration_s":0.000852,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018562,"completed_at":"2026-10-25T16:27:12.332Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 246.652674] nix-daemon[2794]: accepted connection from pid 3656, user nixbot2239gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2240gitlab # [ 247.383845] gitaly[899]: time="2026-10-25T16:27:13.879Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6EG3HD36JVXXTM3FDQXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:43.578" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:13.878" grpc.time_ms=0.788 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241gitlab # [ 247.415940] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1152242gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.16 seconds)2243gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2244gitlab # [ 248.515256] gitaly[899]: time="2026-10-25T16:27:15.010Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6FMBAA8RJMFSN8RRSGT4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:45.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:15.009" grpc.time_ms=0.871 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 248.539394] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 792246gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.13 seconds)2247gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2248gitlab # [ 249.682091] gitaly[899]: time="2026-10-25T16:27:16.177Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6GQMKEHV5S6S7ZN4P1ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:46.176" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:16.176" grpc.time_ms=0.81 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab # [ 249.731906] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1422250gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.19 seconds)2251gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2252gitlab # [ 250.829960] gitaly[899]: time="2026-10-25T16:27:17.325Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6HWPKCZZDW0HPZ6DMW7F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:47.124" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:17.324" grpc.time_ms=0.782 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 250.858170] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 832254gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.12 seconds)2255gitlab # [ 251.783705] nix-daemon[2794]: accepted connection from pid 3701, user nixbot2256gitlab # [ 251.796897] nix-daemon[2794]: accepted connection from pid 3656, user nixbot2257gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2258gitlab # [ 251.884141] gitaly[899]: time="2026-10-25T16:27:18.379Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:48.375" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:18.376" grpc.time_ms=1.145 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 251.910588] gitaly[899]: time="2026-10-25T16:27:18.406Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:28.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:18.400" grpc.time_ms=5.754 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 251.936157] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"266df47bc2c7ba76b2cef361","created_at":"2026-10-25T16:27:18.372Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1c07e4ce0d60a9da8dbf55c279e812e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.429Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-266df47bc2c7ba76b2cef361: start","job_status":"start","queue_duration_s":0.001694,"scheduling_latency_s":0.001721}2261gitlab # [ 251.946646] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1062262gitlab # [ 251.954173] gitaly[899]: time="2026-10-25T16:27:18.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6JZRX4QXSYP4Y9F1708T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:48.248" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:18.449" grpc.time_ms=1.055 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 251.981836] gitaly[899]: time="2026-10-25T16:27:18.476Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6K1EXP9W99YSAV6FWBMG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:48.475" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:18.475" grpc.time_ms=0.521 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 251.984398] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"266df47bc2c7ba76b2cef361","created_at":"2026-10-25T16:27:18.372Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1c07e4ce0d60a9da8dbf55c279e812e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.429Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-266df47bc2c7ba76b2cef361: done: 0.049134 sec","job_status":"done","queue_duration_s":0.001694,"scheduling_latency_s":0.001721,"redis_calls":9,"redis_duration_s":0.001306,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.049134,"completed_at":"2026-10-25T16:27:18.480Z","load_balancing_strategy":"primary","db_duration_s":0.009908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 251.992478] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.488Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3d52977cb508a8a3b0a5e5ef","created_at":"2026-10-25T16:27:18.429Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-deeecce39d694441","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.432Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3d52977cb508a8a3b0a5e5ef: start","job_status":"start","queue_duration_s":0.055602,"scheduling_latency_s":0.055625}2266gitlab # [ 252.053316] gitaly[899]: time="2026-10-25T16:27:18.549Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6K1EXP9W99YSAV6FWBMG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:28.154" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:18.544" grpc.time_ms=5.047 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2267gitlab # [ 252.057371] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 1612268gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.21 seconds)2269gitlab # [ 252.100211] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1492270gitlab # [ 252.152508] gitaly[899]: time="2026-10-25T16:27:18.648Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6K6JGT22NSF3DYYZY6H6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:48.645" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:18.645" grpc.time_ms=2.89 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 252.183659] gitaly[899]: time="2026-10-25T16:27:18.680Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6K6JGT22NSF3DYYZY6H6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-25T16:27:28.283" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:18.674" grpc.time_ms=5.774 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 252.212019] gitaly[899]: time="2026-10-25T16:27:18.708Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:48.607" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:18.707" grpc.time_ms=0.696 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 252.216922] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/43b3ea314fe878bc7ebde23450b44215d801b8bd HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1022274gitlab # [ 252.324975] gitaly[899]: time="2026-10-25T16:27:18.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:48.718" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:18.819" grpc.time_ms=1.329 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 252.350231] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.836Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"60bb487babf68dc989d89da3","created_at":"2026-10-25T16:27:18.833Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-3bbf9e9bf4354f15","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"3d52977cb508a8a3b0a5e5ef","job_size_bytes":3,"pid":2511,"job_status":"deduplicated","message":"PipelineProcessWorker JID-60bb487babf68dc989d89da3: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2276gitlab # [ 252.368250] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3d52977cb508a8a3b0a5e5ef","created_at":"2026-10-25T16:27:18.429Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-deeecce39d694441","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.432Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2511,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3d52977cb508a8a3b0a5e5ef: rescheduled"}2277gitlab # [ 252.381785] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.867Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3d52977cb508a8a3b0a5e5ef","created_at":"2026-10-25T16:27:18.429Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-deeecce39d694441","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.432Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3d52977cb508a8a3b0a5e5ef: done: 0.379007 sec","job_status":"done","queue_duration_s":0.055602,"scheduling_latency_s":0.055625,"gitaly_calls":2,"gitaly_duration_s":0.023747,"redis_calls":43,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.035942,"redis_read_bytes":168,"redis_write_bytes":8134,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001384,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001574,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":6,"redis_queues_duration_s":0.001258,"redis_queues_read_bytes":7,"redis_queues_write_bytes":3277,"redis_queues_metadata_calls":12,"redis_queues_metadata_duration_s":0.011134,"redis_queues_metadata_read_bytes":91,"redis_queues_metadata_write_bytes":1640,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000218,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001253,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.017737,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.155,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.115,"db_ci_duration_s":0.041,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088703,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21887698,"duration_s":0.379007,"completed_at":"2026-10-25T16:27:18.867Z","load_balancing_strategy":"primary","db_duration_s":0.161312,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab # [ 252.427393] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:18.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ff62be5718150d7cc320bdd5","created_at":"2026-10-25T16:27:18.452Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ac17803cbba5daa4006ebe7e600f980","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.542Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ff62be5718150d7cc320bdd5: start","job_status":"start","queue_duration_s":0.326185,"scheduling_latency_s":0.326203}2279gitlab # [ 252.439856] nixbot[2634]: {"ts": "2026-10-25T16:27:18.873Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "43b3ea314fe878bc7ebde23450b44215d801b8bd", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2280gitlab # [ 252.442982] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 362281gitlab # [ 252.445209] gitaly[899]: time="2026-10-25T16:27:18.935Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6KFKP1BN8AM6RRNR2VDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:18.928" grpc.time_ms=6.455 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2282gitlab # [ 252.485610] gitaly[899]: time="2026-10-25T16:27:18.981Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6KGRR0JNR9CPM0VT4DFS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:18.975" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2283gitlab # [ 252.486090] gitaly[899]: time="2026-10-25T16:27:18.982Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6KGRR0JNR9CPM0VT4DFS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:18.975" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2284gitlab # [ 252.490456] gitaly[899]: time="2026-10-25T16:27:18.986Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6KGRR0JNR9CPM0VT4DFS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-25T16:27:18.975" grpc.time_ms=10.868 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc2285gitlab # [ 252.507324] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ff62be5718150d7cc320bdd5","created_at":"2026-10-25T16:27:18.452Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ac17803cbba5daa4006ebe7e600f980","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.542Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ff62be5718150d7cc320bdd5: done: 0.134812 sec","job_status":"done","queue_duration_s":0.326185,"scheduling_latency_s":0.326203,"redis_calls":70,"redis_duration_s":0.034179,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.008517,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000423,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.024536,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.134812,"completed_at":"2026-10-25T16:27:19.003Z","load_balancing_strategy":"primary","db_duration_s":0.006265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 252.549080] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8ca7d957c3c3b908cea232be","created_at":"2026-10-25T16:27:18.585Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53a50561d1f4e3f7b10ab54b15995958","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.592Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8ca7d957c3c3b908cea232be: start","job_status":"start","queue_duration_s":0.41164,"scheduling_latency_s":0.411659}2287gitlab # [ 252.549670] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8ca7d957c3c3b908cea232be","created_at":"2026-10-25T16:27:18.585Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53a50561d1f4e3f7b10ab54b15995958","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.592Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8ca7d957c3c3b908cea232be: done: 0.016676 sec","job_status":"done","queue_duration_s":0.41164,"scheduling_latency_s":0.411659,"redis_calls":11,"redis_duration_s":0.001459,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000339708,"exclusive_lock_hold_duration_s":0.003835683,"duration_s":0.016676,"completed_at":"2026-10-25T16:27:19.021Z","load_balancing_strategy":"primary","db_duration_s":0.001958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 252.600832] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1139fa49049cd31b5f4106ec","created_at":"2026-10-25T16:27:18.604Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe678a1d2c1ca0fd12a3c5eebf9530cb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.616Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1139fa49049cd31b5f4106ec: start","job_status":"start","queue_duration_s":0.405315,"scheduling_latency_s":0.405328}2289gitlab # [ 252.601916] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.042Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1139fa49049cd31b5f4106ec","created_at":"2026-10-25T16:27:18.604Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe678a1d2c1ca0fd12a3c5eebf9530cb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.616Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1139fa49049cd31b5f4106ec: done: 0.020724 sec","job_status":"done","queue_duration_s":0.405315,"scheduling_latency_s":0.405328,"redis_calls":18,"redis_duration_s":0.0024289999999999997,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000261,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020724,"completed_at":"2026-10-25T16:27:19.042Z","load_balancing_strategy":"primary","db_duration_s":0.000991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 252.616195] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3384d3e47599873fec8360a0","created_at":"2026-10-25T16:27:18.621Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b61654d193c23175bef7f44093d2813a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T16:27:18.630Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3384d3e47599873fec8360a0: start","job_status":"start","queue_duration_s":0.413916,"scheduling_latency_s":0.41393}2291gitlab # [ 252.628663] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.050Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2292gitlab # [ 252.632078] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3384d3e47599873fec8360a0","created_at":"2026-10-25T16:27:18.621Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b61654d193c23175bef7f44093d2813a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-25T16:27:18.630Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3384d3e47599873fec8360a0: done: 0.010818 sec","job_status":"done","queue_duration_s":0.413916,"scheduling_latency_s":0.41393,"redis_calls":9,"redis_duration_s":0.001113,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010818,"completed_at":"2026-10-25T16:27:19.054Z","load_balancing_strategy":"primary","db_duration_s":0.000242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 252.671173] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cc1d0746c7567349d3083053","created_at":"2026-10-25T16:27:18.645Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec77a8bca942b49a3a5487eee58feb89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.663Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cc1d0746c7567349d3083053: start","job_status":"start","queue_duration_s":0.392898,"scheduling_latency_s":0.392911}2294gitlab # [ 252.681270] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.062Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2295gitlab # [ 252.684684] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cc1d0746c7567349d3083053","created_at":"2026-10-25T16:27:18.645Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec77a8bca942b49a3a5487eee58feb89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.663Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cc1d0746c7567349d3083053: done: 0.010708 sec","job_status":"done","queue_duration_s":0.392898,"scheduling_latency_s":0.392911,"redis_calls":9,"redis_duration_s":0.001081,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010708,"completed_at":"2026-10-25T16:27:19.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 252.724249] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5f3e70517324bf60caff59c5","created_at":"2026-10-25T16:27:18.668Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-3bbf9e9bf4354f15","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.671Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5f3e70517324bf60caff59c5: start","job_status":"start","queue_duration_s":0.396094,"scheduling_latency_s":0.396107}2297gitlab # [ 252.764836] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.087Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5f3e70517324bf60caff59c5","created_at":"2026-10-25T16:27:18.668Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-3bbf9e9bf4354f15","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.671Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5f3e70517324bf60caff59c5: done: 0.020169 sec","job_status":"done","queue_duration_s":0.396094,"scheduling_latency_s":0.396107,"redis_calls":7,"redis_duration_s":0.0009009999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020169,"completed_at":"2026-10-25T16:27:19.087Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2298gitlab # [ 252.773469] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"427753d9aecd3cca6529218c","created_at":"2026-10-25T16:27:18.669Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3587d9560bc99d2eab11a0cc47ec26e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T16:27:18.678Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-427753d9aecd3cca6529218c: start","job_status":"start","queue_duration_s":0.410525,"scheduling_latency_s":0.410539}2299gitlab # [ 252.811794] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.095Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2300gitlab # [ 252.812678] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"427753d9aecd3cca6529218c","created_at":"2026-10-25T16:27:18.669Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3587d9560bc99d2eab11a0cc47ec26e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-25T16:27:18.678Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-427753d9aecd3cca6529218c: done: 0.010643 sec","job_status":"done","queue_duration_s":0.410525,"scheduling_latency_s":0.410539,"redis_calls":9,"redis_duration_s":0.001109,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010643,"completed_at":"2026-10-25T16:27:19.099Z","load_balancing_strategy":"primary","db_duration_s":0.00022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2301gitlab # [ 252.824735] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.100Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"415559f4bd9729d3b0da0aaa","created_at":"2026-10-25T16:27:18.677Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-3bbf9e9bf4354f15","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.682Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-415559f4bd9729d3b0da0aaa: start","job_status":"start","queue_duration_s":0.417406,"scheduling_latency_s":0.417419}2302gitlab # [ 252.839288] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.113Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"415559f4bd9729d3b0da0aaa","created_at":"2026-10-25T16:27:18.677Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-3bbf9e9bf4354f15","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.682Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-415559f4bd9729d3b0da0aaa: done: 0.013399 sec","job_status":"done","queue_duration_s":0.417406,"scheduling_latency_s":0.417419,"redis_calls":7,"redis_duration_s":0.000849,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013399,"completed_at":"2026-10-25T16:27:19.113Z","load_balancing_strategy":"primary","db_duration_s":0.00181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2303gitlab # [ 252.882792] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.114Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5fa6f0076d8c27c41b8c686f","created_at":"2026-10-25T16:27:18.680Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43d185018659a58419724ce97fd17790","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.688Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5fa6f0076d8c27c41b8c686f: start","job_status":"start","queue_duration_s":0.426293,"scheduling_latency_s":0.426314}2304gitlab # [ 252.887925] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5fa6f0076d8c27c41b8c686f","created_at":"2026-10-25T16:27:18.680Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43d185018659a58419724ce97fd17790","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.688Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5fa6f0076d8c27c41b8c686f: done: 0.016813 sec","job_status":"done","queue_duration_s":0.426293,"scheduling_latency_s":0.426314,"redis_calls":9,"redis_duration_s":0.0013679999999999999,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016813,"completed_at":"2026-10-25T16:27:19.131Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 252.929111] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"439297a5548e0f0121a3f856","created_at":"2026-10-25T16:27:18.690Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6595ca3f0dc979e2f03e3265366d25a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.693Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-439297a5548e0f0121a3f856: start","job_status":"start","queue_duration_s":0.438759,"scheduling_latency_s":0.438775}2306gitlab # [ 252.972092] gitaly[899]: time="2026-10-25T16:27:19.345Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:19.344" grpc.time_ms=0.473 pid=899 span.kind=server system=grpc2307gitlab # [ 252.972691] gitaly[899]: time="2026-10-25T16:27:19.363Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:19.363" grpc.time_ms=0.299 pid=899 span.kind=server system=grpc2308gitlab # [ 252.973694] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"439297a5548e0f0121a3f856","created_at":"2026-10-25T16:27:18.690Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6595ca3f0dc979e2f03e3265366d25a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.693Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-439297a5548e0f0121a3f856: done: 0.018149 sec","job_status":"done","queue_duration_s":0.438759,"scheduling_latency_s":0.438775,"redis_calls":12,"redis_duration_s":0.001739,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004854528,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.018149,"completed_at":"2026-10-25T16:27:19.150Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001429,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2309gitlab # [ 252.994223] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"44b7848a98d5f2d476a51923","created_at":"2026-10-25T16:27:18.704Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ef5f710de9fd4d3521f9da9dcf78aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.710Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-44b7848a98d5f2d476a51923: start","job_status":"start","queue_duration_s":0.440345,"scheduling_latency_s":0.440357}2310gitlab # [ 253.007446] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.157Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2311gitlab # [ 253.010658] gitaly[899]: time="2026-10-25T16:27:19.381Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-25T16:27:19.381" grpc.time_ms=0.262 pid=899 span.kind=server system=grpc2312gitlab # [ 253.019455] gitaly[899]: time="2026-10-25T16:27:19.393Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 diskcache=e6d74642-0bbc-4258-8849-9be5eb551acf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:49.223" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:19.324" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses2314gitlab # [ 253.028092] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"44b7848a98d5f2d476a51923","created_at":"2026-10-25T16:27:18.704Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ef5f710de9fd4d3521f9da9dcf78aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.710Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-44b7848a98d5f2d476a51923: done: 0.010639 sec","job_status":"done","queue_duration_s":0.440345,"scheduling_latency_s":0.440357,"redis_calls":9,"redis_duration_s":0.001108,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010639,"completed_at":"2026-10-25T16:27:19.161Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 253.069938] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"adfd4390b566dd13b7d1ee16","created_at":"2026-10-25T16:27:18.716Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13e69e0d8c782365a2c7debff3e67019","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.722Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-adfd4390b566dd13b7d1ee16: start","job_status":"start","queue_duration_s":0.440345,"scheduling_latency_s":0.440358}2316gitlab # [ 253.077672] gitaly[899]: time="2026-10-25T16:27:19.393Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7238 command.oublock=0 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-25T16:27:49.223" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-25T16:27:19.324" grpc.time_ms=68.974 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 253.088548] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"adfd4390b566dd13b7d1ee16","created_at":"2026-10-25T16:27:18.716Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13e69e0d8c782365a2c7debff3e67019","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.722Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-adfd4390b566dd13b7d1ee16: done: 0.012435 sec","job_status":"done","queue_duration_s":0.440345,"scheduling_latency_s":0.440358,"redis_calls":11,"redis_duration_s":0.001358,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000289701,"exclusive_lock_hold_duration_s":0.001506058,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.012435,"completed_at":"2026-10-25T16:27:19.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 253.133947] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"babab5c7563550ebd303051c","created_at":"2026-10-25T16:27:18.726Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da45fd8991a2e08982b8a7e9591fd1e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.735Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-babab5c7563550ebd303051c: start","job_status":"start","queue_duration_s":0.440297,"scheduling_latency_s":0.440309}2319gitlab # [ 253.173049] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.182Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2320gitlab # [ 253.173776] gitaly[899]: time="2026-10-25T16:27:19.467Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=38 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=38 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-25T16:27:49.328" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:19.428" grpc.time_ms=38.486 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 253.174554] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"babab5c7563550ebd303051c","created_at":"2026-10-25T16:27:18.726Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da45fd8991a2e08982b8a7e9591fd1e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.735Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-babab5c7563550ebd303051c: done: 0.010646 sec","job_status":"done","queue_duration_s":0.440297,"scheduling_latency_s":0.440309,"redis_calls":9,"redis_duration_s":0.00106,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010646,"completed_at":"2026-10-25T16:27:19.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab # [ 253.212475] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"693686e8cca946f93bf71c0a","created_at":"2026-10-25T16:27:18.806Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11c1334a12ea7fa43893585e57db245","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.816Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-693686e8cca946f93bf71c0a: start","job_status":"start","queue_duration_s":0.371273,"scheduling_latency_s":0.371286}2323gitlab # [ 253.213095] gitaly[899]: time="2026-10-25T16:27:19.486Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6JY0SSSMESRE7KCPP7H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-25T16:27:49.385" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-25T16:27:19.486" grpc.time_ms=0.587 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2324gitlab # [ 253.213694] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"693686e8cca946f93bf71c0a","created_at":"2026-10-25T16:27:18.806Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11c1334a12ea7fa43893585e57db245","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.816Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-693686e8cca946f93bf71c0a: done: 0.030218 sec","job_status":"done","queue_duration_s":0.371273,"scheduling_latency_s":0.371286,"redis_calls":11,"redis_duration_s":0.001506,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000332165,"exclusive_lock_hold_duration_s":0.015821284,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.030218,"completed_at":"2026-10-25T16:27:19.217Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses, in 0.22 seconds)2326(finished: subtest: eval and build post commit statuses, in 8.35 seconds)2327(finished: run the VM test script, in 306.22 seconds)2328gitlab # [ 253.260744] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0acd91efb8af02be8d3632df","created_at":"2026-10-25T16:27:18.825Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4822d2ee2a130d1494d422ec887d0805","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.832Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0acd91efb8af02be8d3632df: start","job_status":"start","queue_duration_s":0.385868,"scheduling_latency_s":0.385881}2329gitlab # [ 253.263853] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0acd91efb8af02be8d3632df","created_at":"2026-10-25T16:27:18.825Z","trace_propagation_headers":{"sentry-trace":"d82a687f49ed41e69620964e2edb45ca-b51fd42665a843fb","baggage":"sentry-trace_id=d82a687f49ed41e69620964e2edb45ca,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4822d2ee2a130d1494d422ec887d0805","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.832Z","job_size_bytes":2,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0acd91efb8af02be8d3632df: done: 0.012506 sec","job_status":"done","queue_duration_s":0.385868,"scheduling_latency_s":0.385881,"redis_calls":11,"redis_duration_s":0.001354,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012506,"completed_at":"2026-10-25T16:27:19.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 253.343381] sidekiq-cluster[2511]: {"severity":"INFO","time":"2026-10-25T16:27:19.231Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"b859cb27a6f5ab8630090856","created_at":"2026-10-25T16:27:18.843Z","trace_propagation_headers":{"sentry-trace":"32dc315a3ac74a47966a399a426bce71-3bbf9e9bf4354f15","baggage":"sentry-trace_id=32dc315a3ac74a47966a399a426bce71,sentry-release=Unknown"},"correlation_id":"01M5SY6JY0SSSMESRE7KCPP7H1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-25T16:27:18.846Z","job_size_bytes":3,"pid":2511,"sidekiq_tid":"m7x7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b859cb27a6f5ab8630090856: start","job_status":"start","queue_duration_s":0.38511,"scheduling_latency_s":0.385123}2331gitlab # [ 253.359568] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/43b3ea314fe878bc7ebde23450b44215d801b8bd/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1082332gitlab # [ 253.362423] gitlab-workhorse[822]: time="2026-10-25T16:27:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672333gitlab # [ 253.364223] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/25:16:27:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 8712334test script finished in 306.29s2335cleanup2336kill QemuMachine (pid 46)2337gitlab # [ 253.366455] gitaly[899]: time="2026-10-25T16:27:19.738Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5SY6M6W518KQ835NMRTYTT9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2338(finished: cleanup, in 1.63 seconds)2339additionally exposed symbols:2340 gitlab,2341 vlan1,2342 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2343[]2344[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-25T16:26:23.824Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2345[]2346[]2347[]2348[]2349[]2350[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-25T16:27:11.182111Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2351[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2352[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2353[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2354[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2355[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2356[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2357[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': '2026-10-25T16:27:18.421Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2358[{'id': 5, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-10-25T16:27:11.467Z', 'started_at': None, 'finished_at': '2026-10-25T16:27:18.421Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '43b3ea314fe878bc7ebde23450b44215d801b8bd', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-25T16:27:18.578Z', 'started_at': None, 'finished_at': '2026-10-25T16:27:18.696Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]