tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab: QEMU running (pid 46) gitlab # Formatting '/build/vm-state-gitlab/tmp.QuQ5nBcrIJ', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 7db57d7e-ee0f-4d69-8e4b-3c594e21cd33 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done (finished: start all VMs, in 49.13 seconds) gitlab # Creating journal (8192 blocks): done gitlab: waiting for unit setup-gitlab.service gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab: waiting for the VM to finish booting gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ng416ws9ajk3kl2ys4gxs43bva6f12rp-nixos-system-gitlab-test/init regInfo=/nix/store/6jrrpdrzi0inws3z8kbgwwwxcinz1k39-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 467923827 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002727] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002744] Using GB pages for direct mapping gitlab # [ 0.002842] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002850] ACPI: Early table checksum verification disabled gitlab # [ 0.002852] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002857] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002860] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002868] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002870] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002871] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002873] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002874] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002876] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002877] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002877] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002878] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002878] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002879] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003096] No NUMA configuration found gitlab # [ 0.003097] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003099] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005488] Zone ranges: gitlab # [ 0.005489] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005490] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005491] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005492] Device empty gitlab # [ 0.005493] Movable zone start for each node gitlab # [ 0.005494] Early memory node ranges gitlab # [ 0.005494] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005495] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005496] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005497] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005517] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005802] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.119115] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.119537] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.119552] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.119587] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.119590] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.119592] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.119593] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.119594] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.119595] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.119598] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.119599] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.119604] TSC deadline timer available gitlab # [ 0.119609] CPU topo: Max. logical packages: 1 gitlab # [ 0.119609] CPU topo: Max. logical dies: 1 gitlab # [ 0.119610] CPU topo: Max. dies per package: 1 gitlab # [ 0.119613] CPU topo: Max. threads per core: 1 gitlab # [ 0.119614] CPU topo: Num. cores per package: 4 gitlab # [ 0.119614] CPU topo: Num. threads per package: 4 gitlab # [ 0.119615] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.119641] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.119660] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.119662] kvm-guest: setup PV sched yield gitlab # [ 0.119681] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.119683] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.119684] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.119685] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.119687] Booting paravirtualized kernel on KVM gitlab # [ 0.119691] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.124167] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.126515] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.126568] kvm-guest: PV spinlocks enabled gitlab # [ 0.126570] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.126573] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ng416ws9ajk3kl2ys4gxs43bva6f12rp-nixos-system-gitlab-test/init regInfo=/nix/store/6jrrpdrzi0inws3z8kbgwwwxcinz1k39-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.126672] Unknown kernel command line parameters "regInfo=/nix/store/6jrrpdrzi0inws3z8kbgwwwxcinz1k39-closure-info/registration", will be passed to user space. gitlab # [ 0.126685] random: crng init done gitlab # [ 0.126686] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.135935] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.140407] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.140488] software IO TLB: area num 4. gitlab # [ 0.219765] Fallback order for Node 0: 0 gitlab # [ 0.219775] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.219777] Policy zone: Normal gitlab # [ 0.222426] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.232878] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.247083] allocated 12582912 bytes of page_ext gitlab # [ 0.257499] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.257501] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.258388] Dynamic Preempt: lazy gitlab # [ 0.258549] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.258549] rcu: RCU event tracing is enabled. gitlab # [ 0.258550] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.258552] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.258553] Rude variant of Tasks RCU enabled. gitlab # [ 0.258553] Tracing variant of Tasks RCU enabled. gitlab # [ 0.258554] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.258555] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.258570] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.258572] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.258573] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.263024] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.263351] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.263361] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.263482] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.267070] Console: colour VGA+ 80x25 gitlab # [ 0.267073] printk: legacy console [tty0] enabled gitlab # [ 0.298130] printk: legacy console [ttyS0] enabled gitlab # [ 0.404689] ACPI: Core revision 20250807 gitlab # [ 0.405679] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.407255] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.408244] x2apic enabled gitlab # [ 0.409004] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.409886] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.411067] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.412561] kvm-guest: setup PV IPIs gitlab # [ 0.414192] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.415205] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.416960] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.419039] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.420088] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.421959] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.422956] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.423958] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.425958] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.426957] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.427957] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.428956] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.429965] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.431533] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.432958] active return thunk: srso_alias_return_thunk gitlab # [ 0.433979] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.434957] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.435957] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.436957] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.437957] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.438957] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.439957] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.441958] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.442958] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.443957] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.444957] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.445957] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.446958] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.477564] Freeing SMP alternatives memory: 44K gitlab # [ 0.477961] pid_max: default: 32768 minimum: 301 gitlab # [ 0.479076] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.480056] landlock: Up and running. gitlab # [ 0.480710] Yama: becoming mindful. gitlab # [ 0.481977] LSM support for eBPF active gitlab # [ 0.482881] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.484112] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.486822] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.487536] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.487963] ... version: 2 gitlab # [ 0.488693] ... bit width: 48 gitlab # [ 0.488960] ... generic counters: 6 gitlab # [ 0.489707] ... generic bitmap: 000000000000003f gitlab # [ 0.489972] ... fixed-purpose counters: 0 gitlab # [ 0.490725] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.490960] ... value mask: 0000ffffffffffff gitlab # [ 0.491901] ... max period: 00007fffffffffff gitlab # [ 0.492666] ... global_ctrl mask: 000000000000003f gitlab # [ 0.493082] signal: max sigframe size: 3376 gitlab # [ 0.493939] rcu: Hierarchical SRCU implementation. gitlab # [ 0.494603] rcu: Max phase no-delay instances is 400. gitlab # [ 0.495156] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.500619] smp: Bringing up secondary CPUs ... gitlab # [ 0.501366] smpboot: x86: Booting SMP configuration: gitlab # [ 0.501963] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.505100] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.506646] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.507245] Memory: 6011576K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.508395] devtmpfs: initialized gitlab # [ 0.509586] x86/mm: Memory block size: 128MB gitlab # [ 0.513027] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.514050] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.515067] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.516303] PM: RTC time: 23:41:06, date: 2026-08-15 gitlab # [ 0.519971] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.522513] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.523027] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.525129] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.525974] audit: initializing netlink subsys (disabled) gitlab # [ 0.527025] audit: type=2000 audit(1786837266.604:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.527257] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.528961] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.529960] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.530960] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.531959] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.532974] cpuidle: using governor menu gitlab # [ 0.535171] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.536234] PCI: Using configuration type 1 for base access gitlab # [ 0.536961] PCI: Using configuration type 1 for extended access gitlab # [ 0.538118] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.539994] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.540961] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.541961] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.542960] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.546189] ACPI: Added _OSI(Module Device) gitlab # [ 0.546962] ACPI: Added _OSI(Processor Device) gitlab # [ 0.547739] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.551001] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.555240] ACPI: Interpreter enabled gitlab # [ 0.555979] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.556687] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.556991] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.557962] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.559119] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.563692] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.564968] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.567408] acpiphp: Slot [3] registered gitlab # [ 0.567982] acpiphp: Slot [4] registered gitlab # [ 0.568722] acpiphp: Slot [5] registered gitlab # [ 0.569004] acpiphp: Slot [6] registered gitlab # [ 0.569705] acpiphp: Slot [7] registered gitlab # [ 0.570980] acpiphp: Slot [8] registered gitlab # [ 0.571718] acpiphp: Slot [9] registered gitlab # [ 0.571982] acpiphp: Slot [10] registered gitlab # [ 0.572695] acpiphp: Slot [11] registered gitlab # [ 0.573981] acpiphp: Slot [12] registered gitlab # [ 0.574733] acpiphp: Slot [13] registered gitlab # [ 0.574999] acpiphp: Slot [14] registered gitlab # [ 0.575695] acpiphp: Slot [15] registered gitlab # [ 0.576984] acpiphp: Slot [16] registered gitlab # [ 0.577731] acpiphp: Slot [17] registered gitlab # [ 0.577980] acpiphp: Slot [18] registered gitlab # [ 0.578700] acpiphp: Slot [19] registered gitlab # [ 0.578989] acpiphp: Slot [20] registered gitlab # [ 0.579741] acpiphp: Slot [21] registered gitlab # [ 0.580980] acpiphp: Slot [22] registered gitlab # [ 0.581709] acpiphp: Slot [23] registered gitlab # [ 0.581990] acpiphp: Slot [24] registered gitlab # [ 0.582735] acpiphp: Slot [25] registered gitlab # [ 0.583981] acpiphp: Slot [26] registered gitlab # [ 0.584724] acpiphp: Slot [27] registered gitlab # [ 0.584990] acpiphp: Slot [28] registered gitlab # [ 0.585679] acpiphp: Slot [29] registered gitlab # [ 0.586981] acpiphp: Slot [30] registered gitlab # [ 0.587707] acpiphp: Slot [31] registered gitlab # [ 0.587976] PCI host bridge to bus 0000:00 gitlab # [ 0.588685] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.589961] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.590961] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.591960] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.593987] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.594973] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.596190] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.598431] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.599388] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.602990] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.603897] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.604835] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.605759] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.606815] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.607977] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.611005] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.612830] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.614238] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.615966] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.617182] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.631030] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.631974] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.632983] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.635049] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.637302] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.642981] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.643890] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.644765] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.656922] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.660397] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.663995] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.664849] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.665736] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.668192] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.672991] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.674967] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.675938] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.678186] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.681993] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.682863] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.683709] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.686228] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.689994] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.690898] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.691766] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.694787] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.698995] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.699850] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.700762] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.707777] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.718993] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.721982] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.724020] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.726980] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.732427] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.740000] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.742021] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.748164] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.758002] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.759976] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.762018] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.766402] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.770983] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.771859] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.772715] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.777881] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.778852] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.780092] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.782086] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.783034] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.785227] iommu: Default domain type: Translated gitlab # [ 0.785963] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.788393] ACPI: bus type USB registered gitlab # [ 0.790004] usbcore: registered new interface driver usbfs gitlab # [ 0.792011] usbcore: registered new interface driver hub gitlab # [ 0.793010] usbcore: registered new device driver usb gitlab # [ 0.796228] NetLabel: Initializing gitlab # [ 0.796857] NetLabel: domain hash size = 128 gitlab # [ 0.797535] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.798044] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.798970] PCI: Using ACPI for IRQ routing gitlab # [ 0.801147] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.801956] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.801956] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.803964] vgaarb: loaded gitlab # [ 0.804702] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.805961] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.810048] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.813475] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.814211] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.815706] pnp: PnP ACPI init gitlab # [ 0.816873] pnp: PnP ACPI: found 6 devices gitlab # [ 0.829635] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.833248] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.835966] NET: Registered PF_INET protocol family gitlab # [ 0.840944] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.873777] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.875265] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.876701] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.880494] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.881868] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.883080] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.884428] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.885618] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.886978] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.887978] NET: Registered PF_XDP protocol family gitlab # [ 0.888858] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.889900] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.890939] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.892074] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.893205] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.894567] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.895571] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.898034] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.901128] PCI: CLS 0 bytes, default 64 gitlab # [ 0.901960] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.902547] Trying to unpack rootfs image as initramfs... gitlab # [ 0.903032] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.903160] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.927962] Initialise system trusted keyrings gitlab # [ 0.929240] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 0.941015] Key type asymmetric registered gitlab # [ 0.941725] Asymmetric key parser 'x509' registered gitlab # [ 0.942687] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 0.944346] io scheduler mq-deadline registered gitlab # [ 0.945174] io scheduler kyber registered gitlab # [ 0.948419] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.950111] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 0.952780] Linux agpgart interface v0.103 gitlab # [ 0.953672] ACPI: bus type drm_connector registered gitlab # [ 0.956472] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.957662] usbserial: USB Serial support registered for generic gitlab # [ 0.958693] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 0.958693] Please enable it if your BIOS has the CPPC option. gitlab # [ 0.961029] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 0.962543] drop_monitor: Initializing network drop monitor service gitlab # [ 0.963807] NET: Registered PF_INET6 protocol family gitlab # [ 0.965566] Segment Routing with IPv6 gitlab # [ 0.966268] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.968222] IPI shorthand broadcast: enabled gitlab # [ 0.972753] sched_clock: Marking stable (827012717, 145595648)->(994051766, -21443401) gitlab # [ 0.974540] registered taskstats version 1 gitlab # [ 0.975617] Loading compiled-in X.509 certificates gitlab # [ 0.985510] Demotion targets for Node 0: null gitlab # [ 0.986718] Key type .fscrypt registered gitlab # [ 0.987404] Key type fscrypt-provisioning registered gitlab # [ 0.988457] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.989421] ima: Allocated hash algorithm: sha1 gitlab # [ 0.990297] ima: No architecture policies found gitlab # [ 0.991428] PM: Magic number: 6:713:706 gitlab # [ 0.993091] RAS: Correctable Errors collector initialized. gitlab # [ 0.997658] clk: Disabling unused clocks gitlab # [ 0.998376] PM: genpd: Disabling unused power domains gitlab # [ 1.213660] Freeing initrd memory: 29392K gitlab # [ 1.217553] Freeing unused decrypted memory: 2028K gitlab # [ 1.220496] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.221650] Write protecting the kernel read-only data: 32768k gitlab # [ 1.223791] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.225532] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.277155] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.278420] Run /init as init process gitlab # [ 1.292007] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.315159] fuse: init (API version 7.45) gitlab # [ 1.324127] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.330697] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.334135] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.376096] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.713149] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.753107] systemd[1]: Detected virtualization kvm. gitlab # [ 1.755301] systemd[1]: Detected architecture x86-64. gitlab # [ 1.757411] systemd[1]: Running in initrd. gitlab # [ 1.759990] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.762813] systemd[1]: Hostname set to . gitlab # [ 1.872147] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.910844] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.931285] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.932504] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.933949] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.935112] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.936246] systemd[1]: Reached target Path Units. gitlab # [ 1.937169] systemd[1]: Reached target Slice Units. gitlab # [ 1.938095] systemd[1]: Reached target Swaps. gitlab # [ 1.938935] systemd[1]: Reached target Timer Units. gitlab # [ 1.939924] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.941165] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.942369] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.943388] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.944427] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.945398] systemd[1]: Reached target Socket Units. gitlab # [ 1.947540] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.949581] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.951895] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 1.956686] systemd[1]: Starting Journal Service... gitlab # [ 1.958991] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.960025] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.998718] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.004063] netfs: FS-Cache loaded gitlab # [ 2.006925] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.017071] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.017173] systemd-journald[92]: Collecting audit messages is disabled. gitlab # [ 2.017827] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.024646] 9pnet: Installing 9P2000 support gitlab # [ 2.025133] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.029426] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.031697] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.033556] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.033611] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.038152] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.042668] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.044326] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.051006] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.053201] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.066078] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.920683] systemd-modules-l[ 2.067512] systemd[1]: Started Journal Service. gitlab # oad[93]: Using 4 probe threads gitlab # [ 1.923510] systemd-modules-load[93]: Inserted module 'virtio_gpu' gitlab # [ 1.924547] systemd-modules-load[93]: Inserted module 'virtio_balloon' gitlab # [ 1.925568] systemd-modules-load[93]: Inserted module 'dm_mod' gitlab # [ 1.926515] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.927618] systemd[1]: Reached target Local File Systems. gitlab # [ 1.928539] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.929550] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.932079] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.942944] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.951693] systemd-udevd[106]: Using default interface naming scheme 'v261'. gitlab # [ 1.962828] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.000994] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.002224] systemd[1]: Reached target System Initialization. gitlab # [ 2.003194] systemd[1]: Reached target Basic System. gitlab # [ 2.224895] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.225696] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.226776] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.227627] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.228685] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.229868] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.230891] usb usb1: Product: UHCI Host Controller gitlab # [ 2.231535] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.232269] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.239645] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.241175] SCSI subsystem initialized gitlab # [ 2.242426] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.243154] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.264719] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.273508] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.291346] hub 1-0:1.0: USB hub found gitlab # [ 2.292034] hub 1-0:1.0: 2 ports detected gitlab # [ 2.293151] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.296273] virtio_blk virtio5: [vdb] 11830696 512-byte logical blocks (6.06 GB/5.64 GiB) gitlab # [ 2.316685] scsi host0: ata_piix gitlab # [ 2.319499] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.320883] scsi host1: ata_piix gitlab # [ 2.321462] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.322638] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.180476] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.182823] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.184079] (udev-worker)[141]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.187088] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.199684] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.201972] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.202889] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.203726] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.205783] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.207350] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.229761] systemd-fsck[160]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.233150] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.481346] ata2: found unknown device (class 0) gitlab # [ 2.484169] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.488407] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.512695] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.542959] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.570350] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.680840] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.683696] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.686205] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.687824] usb 1-1: Manufacturer: QEMU gitlab # [ 2.689271] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.720934] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.733436] usbcore: registered new interface driver usbhid gitlab # [ 2.735511] usbhid: USB HID core driver gitlab # [ 2.745441] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.749377] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.858429] systemd[1]: Mounting /sysroot... gitlab # [ 3.159138] EXT4-fs (vda): mounted filesystem 7db57d7e-ee0f-4d69-8e4b-3c594e21cd33 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.020066] systemd[1]: Mounted /sysroot. gitlab # [ 3.021669] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.023554] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.025321] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.027140] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.030239] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.038386] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.043720] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.193324] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.055133] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.058037] systemd[1]: Mounted /sysroot/nix/[ 3.203821] 9p: Installing v9fs 9p2000 file system support gitlab # .rw-store. gitlab # [ 3.059967] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.066637] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.068429] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.069879] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.071675] systemd-sysroot-fstab-check[180]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.074525] systemd[1]: Reload requested from client PID 180 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.077131] systemd[1]: Reloading... gitlab # [ 3.132354] systemd[1]: Reloading finished in 59 ms. gitlab # [ 3.152454] systemd-sysroot-fstab-check[180]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.155194] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.157541] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.159388] systemd-sysroot-fstab-check[180]: Requesting swap.target/start/replace... gitlab # [ 3.161746] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.165247] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.172656] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.174860] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.183691] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.185993] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.859196] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.908169] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.909960] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.911853] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.913671] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.941397] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.945543] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.959266] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.961580] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.965202] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.997201] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.999318] systemd[1]: Stopped target Basic System. gitlab # [ 4.001068] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.002872] systemd[1]: Stopped target Path Units. gitlab # [ 4.004519] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.007889] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.011381] systemd[1]: Stopped target Slice Units. gitlab # [ 4.013177] systemd[1]: Stopped target Socket Units. gitlab # [ 4.014780] systemd[1]: Stopped target System Initialization. gitlab # [ 4.016625] systemd[1]: Stopped target Swaps. gitlab # [ 4.018191] systemd[1]: Stopped target Timer Units. gitlab # [ 4.020368] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.022579] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.024521] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.026877] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.028502] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.032150] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.033852] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.035756] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.037272] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.039221] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.040625] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.042629] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.044640] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.046537] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.048331] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.049759] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.051528] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.053061] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.054115] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.055346] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.056488] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.057188] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.058151] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.059026] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.059942] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.060838] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.061721] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.062735] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.063871] systemd[1]: Closed udev Control Socket. gitlab # [ 4.064616] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.065384] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.066421] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.067279] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.068354] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.069337] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.070295] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.074520] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.075570] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.076755] systemd[1]: Reached target Switch Root. gitlab # [ 4.078484] systemd[1]: Starting NixOS Activation... gitlab # [ 4.196250] initrd-nixos-activation-start[227]: booting system configuration /nix/store/ng416ws9ajk3kl2ys4gxs43bva6f12rp-nixos-system-gitlab-test gitlab # [ 4.240344] initrd-nixos-activation-start[227]: running activation script... gitlab # [ 4.487159] initrd-nixos-activation-start[250]: setting up /etc... gitlab # [ 4.618271] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.620783] systemd[1]: Finished NixOS Activation. gitlab # [ 4.622383] systemd[1]: Starting Switch Root... gitlab # [ 4.642886] systemd[1]: Switching root. gitlab # [ 4.850668] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.947822] NET: Registered PF_VSOCK protocol family gitlab # [ 5.317161] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.327289] systemd[1]: Detected virtualization kvm. gitlab # [ 5.329169] systemd[1]: Detected architecture x86-64. gitlab # [ 5.331168] systemd[1]: Detected first boot. gitlab # [ 5.333754] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.472830] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.576757] systemd[1]: Applying preset policy. gitlab # [ 5.711085] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.825060] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.826376] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.828804] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.830877] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.832255] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.833964] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.834890] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.836095] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.837211] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.838062] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.838828] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.839678] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.840424] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.841240] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.842127] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.843095] systemd[1]: Reached target Path Units. gitlab # [ 5.843835] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.844621] systemd[1]: Reached target Slice Units. gitlab # [ 5.845321] systemd[1]: Reached target Swaps. gitlab # [ 5.846872] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.848875] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.850289] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.851863] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.852790] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.855234] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.856761] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.858700] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.859858] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.861001] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.862390] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.865362] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.866507] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.867426] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.870441] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.872533] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.874646] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.877697] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.886843] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.891719] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.899789] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.903886] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.907684] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.911713] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.946122] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.947893] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.959884] systemd[1]: Starting Journal Service... gitlab # [ 5.963365] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.966711] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.973674] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.974567] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.977987] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.987007] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.988550] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.989606] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.990426] EXT4-fs (vda): re-mounted 7db57d7e-ee0f-4d69-8e4b-3c594e21cd33. gitlab # [ 5.993236] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.994161] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.995500] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.996844] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.998305] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.998424] loop: module loaded gitlab # [ 5.998795] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.001000] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.002731] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.006871] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.007784] systemd-journald[320]: Collecting audit messages is enabled. gitlab # [ 6.007847] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.018724] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.023446] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.024480] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.882315] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.028874] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.030231] systemd[1]: Started Journal Service. gitlab # [ 5.885622] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.886686] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.888620] systemd-modules-load[321]: Using 3 probe threads gitlab # [ 5.889589] systemd-modules-load[321]: Inserted module 'loop' gitlab # [ 5.890628] systemd-modules-load[321]: Inserted module 'tls' gitlab # [ 5.891761] systemd-oomd[322]: No swap; memory pressure usage will be degraded gitlab # [ 5.893272] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.894469] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.895586] systemd[1]: Starting Firewall... gitlab # [ 5.897300] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.907138] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.909076] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.910682] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.059996] systemd-journald[320]: Received client request to flush runtime journal. gitlab # [ 5.952649] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.954313] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.955589] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.956453] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.957274] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.958179] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.959668] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.972946] systemd-udevd[353]: Using default interface naming scheme 'v261'. gitlab # [ 5.992214] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.004022] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.069369] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.092785] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.123474] (udev-worker)[414]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.128456] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.312610] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.172135] (udev-worker)[411]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.174271] (udev-worker)[411[ 6.319707] ACPI: button: Power Button [PWRF] gitlab # ]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.349372] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.351721] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.352222] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.352447] rtc_cmos 00:05: setting system clock to 2026-08-15T23:41:11 UTC (1786837271) gitlab # [ 6.357718] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.364541] FDC 0 is a S82078B gitlab # [ 6.364774] systemd-journald[320]: Time jumped backwards, rotating. gitlab # [ 6.374911] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.377919] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.379636] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.381273] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.384080] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.409502] Console: switching to colour dummy device 80x25 gitlab # [ 6.411040] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.411043] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.414504] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.415222] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.282191] systemd[1]: Finished Firewall. gitlab # [ 6.422636] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.286026] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.430113] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.433676] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.291240] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.294151] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.442083] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6 gitlab # [ 6.296631] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.298961] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.300388] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.337376] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.494220] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 gitlab # [ 6.351488] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.354544] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.507479] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.377952] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.391435] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.393265] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.396428] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.543218] ppdev: user-space parallel port driver gitlab # [ 6.566887] kvm_amd: TSC scaling supported gitlab # [ 6.567386] kvm_amd: Nested Virtualization enabled gitlab # [ 6.568030] kvm_amd: Nested Paging enabled gitlab # [ 6.568639] kvm_amd: LBR virtualization supported gitlab # [ 6.569218] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.569890] kvm_amd: Virtual GIF supported gitlab # [ 6.570407] kvm_amd: Virtual NMI enabled gitlab # [ 6.601426] EDAC MC: Ver: 3.0.0 gitlab # [ 6.467038] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.468771] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.684792] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.716256] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.718113] systemd[1]: Reached target Local File Systems. gitlab # [ 6.720072] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.722348] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.724746] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.726791] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.730169] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.735303] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.766425] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.771764] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.786282] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.794663] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.797560] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.817553] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.830108] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.832900] systemd[1]: Starting Update is Completed... gitlab # [ 6.857542] systemd[1]: Finished Update is Completed. gitlab # [ 6.882182] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.883324] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.116684] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.118914] systemd[1]: Reached target System Initialization. gitlab # [ 7.120991] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.123479] systemd[1]: Started logrotate.timer. gitlab # [ 7.125267] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.127565] systemd[1]: Reached target Timer Units. gitlab # [ 7.129369] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.131544] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.133399] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.135373] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.138171] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.140161] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.142169] systemd[1]: Reached target Socket Units. gitlab # [ 7.189866] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.193423] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.195890] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.200623] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.219460] dbus-broker-launch[576]: Ready gitlab # [ 7.221354] systemd[1]: Reached target Basic System. gitlab # [ 7.223499] systemd[1]: Started backdoor.service. gitlab # [ 7.225840] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.231545] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.242651] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.247728] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.251369] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.261419] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.268948] systemd[1]: Starting resolvconf update... gitlab # connecting to host... gitlab # [ 7.277488] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.279072] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.281141] logrotate[581]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 7.281788] logrotate[581]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.282815] logrotate[581]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.285762] logrotate[581]: Allocating hash table for state file, size 64 entries gitlab # [ 7.286803] logrotate[581]: Handling 4 logs gitlab # [ 7.287855] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.289595] logrotate[581]: considering log /var/log/btmp gitlab # [ 7.290845] logrotate[581]: Creating new state gitlab # [ 7.293042] logrotate[581]: Now: 2026-08-15 23:41 gitlab # [ 7.293344] logrotate[581]: Last rotated at 2026-08-15 23:00 gitlab # [ 7.296118] logrotate[581]: log does not need rotating (log has already been rotated) gitlab # [ 7.296670] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.297460] logrotate[581]: considering log /var/log/wtmp gitlab # [ 7.297869] logrotate[581]: Creating new state gitlab # [ 7.298471] logrotate[581]: Now: 2026-08-15 23:41 gitlab # [ 7.298928] logrotate[581]: Last rotated at 2026-08-15 23:00 gitlab # [ 7.299379] logrotate[581]: log does not need rotating (log has already been rotated) gitlab # [ 7.299840] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.300421] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581) gitlab # [ 7.300861] logrotate[581]: considering log /var/gitlab/state/log/*.log gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.302239] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.302631] logrotate[581]: Creating new state gitlab: connected to guest root shell gitlab # [ 7.303125] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581) gitlab: (connecting took 7.93 seconds) gitlab # [ 7.303683] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab: (finished: waiting for the VM to finish booting, in 7.93 seconds) gitlab # [ 7.304405] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581) gitlab # [ 7.304852] logrotate[581]: considering log /var/log/nginx/*.log gitlab # [ 7.305762] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.306372] logrotate[581]: Creating new state gitlab # [ 7.306799] logrotate[581]: not running postrotate script, since no logs were rotated gitlab # [ 7.307360] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581) gitlab # [ 7.307802] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.314328] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.320215] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.323723] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.327395] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.328217] nsncd[582]: Aug 15 23:41:12.618 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.328864] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.330259] systemd[1]: Starting User Login Management... gitlab # [ 7.370273] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.370769] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.371218] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.371653] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.372100] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.378077] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.379049] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.384470] systemd-logind[618]: New seat seat0. gitlab # [ 7.386412] systemd[1]: nscd.service: Consumed 30ms CPU time over 129ms wall clock time, 7.3M memory peak, 5.5M read from disk. gitlab # [ 7.387100] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.387571] systemd-logind[618]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.388770] systemd-logind[618]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.389483] systemd-logind[618]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.389891] systemd[1]: Started User Login Management. gitlab # [ 7.395058] systemd[1]: Starting linger-users.service... gitlab # [ 7.404415] systemd[1]: Finished resolvconf update. gitlab # [ 7.406514] nsncd[672]: Aug 15 23:41:12.698 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.407237] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.407812] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.409785] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.410487] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.411454] systemd[1]: Starting DHCP Client... gitlab # [ 7.413716] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.414704] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.416596] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.418817] systemd[1]: Finished linger-users.service. gitlab # [ 7.440324] network-addresses-eth1-start[698]: adding address 192.168.1.1/24... done gitlab # [ 7.443780] network-addresses-eth1-start[698]: adding address 2001:db8:1::1/64... done gitlab # [ 7.452535] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.477761] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.478793] systemd[1]: Reached target Network. gitlab # [ 7.480058] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.481939] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.484345] dhcpcd[713]: dhcpcd-10.3.2 starting gitlab # [ 7.485879] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.488362] dhcpcd[767]: dev: loaded udev gitlab # [ 7.490039] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.492414] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.640364] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.641046] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.510588] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.515130] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.518539] systemd[1]: Started Getty on tty1. gitlab # [ 7.520545] systemd[1]: Reached target Login Prompts. gitlab # [ 7.735223] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.744856] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.745687] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.746932] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.747908] cfg80211: failed to load regulatory.db gitlab # [ 7.610533] nginx-pre-start[788]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.611562] nginx-pre-start[788]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.617619] systemd[1]: Started Nginx Web Server. gitlab # [ 7.778151] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.632874] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.634637] postgresql-pre-start[789]: This user must also own the server process. gitlab # [ 7.635632] dhcpcd[767]: eth0: waiting for carrier gitlab # [ 7.636162] dhcpcd[767]: eth0: carrier acquired gitlab # [ 7.636808] dhcpcd[767]: DUID 00:01:00:01:32:13:b5:98:52:54:00:12:34:56 gitlab # [ 7.639023] dhcpcd[767]: eth0: IAID 00:12:34:56 gitlab # [ 7.639920] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.641661] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.642433] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.642794] postgresql-pre-start[789]: The default text search configuration will be set to "english". gitlab # [ 7.642952] postgresql-pre-start[789]: Data page checksums are enabled. gitlab # [ 7.643667] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.644092] postgresql-pre-start[789]: creating subdirectories ... ok gitlab # [ 7.644539] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.645400] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.645879] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.646448] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started gitlab # [ 7.646899] redis-server[790]: Configuration loaded gitlab # [ 7.647589] redis[790]: monotonic clock: POSIX clock_gettime gitlab # [ 7.648829] redis[790]: Running mode=standalone, port=0. gitlab # [ 7.649490] redis[790]: Server initialized gitlab # [ 7.649755] redis[790]: Ready to accept connections unix gitlab # [ 7.650193] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.650791] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.685277] postgresql-pre-start[789]: selecting default "max_connections" ... 100 gitlab # [ 7.722434] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.985632] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.106979] postgresql-pre-start[789]: selecting default time zone ... UTC gitlab # [ 8.109773] postgresql-pre-start[789]: creating configuration files ... ok gitlab # [ 8.215815] gitlab-workhorse[824]: time="2026-08-15T23:41:13Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.217148] gitlab-workhorse[824]: time="2026-08-15T23:41:13Z" level=info msg="Using redis/go-redis" gitlab # [ 8.218056] gitlab-workhorse[824]: time="2026-08-15T23:41:13Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.281778] postgresql-pre-start[789]: running bootstrap script ... ok gitlab # [ 8.676328] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok gitlab # [ 8.679083] dhcpcd[767]: eth0: soliciting a DHCP lease gitlab # [ 8.834898] NET: Registered PF_PACKET protocol family gitlab # [ 8.703966] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.710222] dhcpcd[767]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.869383] postgresql-pre-start[789]: syncing data to disk ... ok gitlab # [ 8.871348] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.873098] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.873852] postgresql-pre-start[789]: Success. You can now start the database server using: gitlab # [ 8.875376] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.008607] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.012583] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.014232] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.022079] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.041714] postgres[859]: [859] LOG: database system was shut down at 2026-08-15 23:41:13 GMT gitlab # [ 9.053693] postgres[850]: [850] LOG: database system is ready to accept connections gitlab # [ 9.059110] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.065154] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.300987] postgresql-setup-start[870]: CREATE DATABASE gitlab # [ 9.323651] postgresql-setup-start[875]: CREATE ROLE gitlab # [ 9.333780] postgresql-setup-start[877]: ALTER DATABASE gitlab # [ 9.356184] postgresql-setup-start[886]: CREATE ROLE gitlab # [ 9.357748] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.359421] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.361619] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.472449] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[884]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.473870] gitlab-postgresql-start[899]: CREATE DATABASE gitlab # [ 9.477133] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[884]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.517785] gitlab-postgresql-start[912]: CREATE EXTENSION gitlab # [ 9.541098] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.545541] systemd[1]: Started gitaly.service. gitlab # [ 9.547769] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.599594] gitlab-postgresql-start[921]: CREATE EXTENSION gitlab # [ 9.605127] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.613561] dhcpcd[767]: eth0: soliciting an IPv6 router gitlab # [ 9.614461] dhcpcd[767]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.615267] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.616293] dhcpcd[767]: eth0: adding route to fec0::/64 gitlab # [ 9.617049] dhcpcd[767]: eth0: adding default route via fe80::2 gitlab # [ 10.118560] gitaly[924]: time="2026-08-15T23:41:15.411Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=924 gitlab # [ 10.119492] gitaly[924]: time="2026-08-15T23:41:15.411Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=924 gitlab # [ 10.120252] gitaly[924]: time="2026-08-15T23:41:15.411Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=924 gitlab # [ 10.120862] gitaly[924]: time="2026-08-15T23:41:15.411Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=924 gitlab # [ 10.122091] gitaly[924]: time="2026-08-15T23:41:15.411Z" level=info msg="Starting Gitaly" pid=924 version= gitlab # [ 10.279398] gitaly[924]: time="2026-08-15T23:41:15.572Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=141 pid=924 gitlab # [ 10.280317] gitaly[924]: time="2026-08-15T23:41:15.572Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=924 gitlab # [ 10.280916] gitaly[924]: time="2026-08-15T23:41:15.572Z" level=info msg="finished initializing command factory" duration_ms=0 pid=924 gitlab # [ 10.281443] gitaly[924]: time="2026-08-15T23:41:15.572Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-924/git-exec-3066529388.d/git pid=924 gitlab # [ 10.288776] gitaly[924]: time="2026-08-15T23:41:15.581Z" level=info msg="finished detecting git version" duration_ms=8 pid=924 gitlab # [ 10.289375] gitaly[924]: time="2026-08-15T23:41:15.581Z" level=info msg="using Git version" pid=924 version=2.53.g gitlab # [ 10.289965] gitaly[924]: time="2026-08-15T23:41:15.582Z" level=info msg="clearing disk cache object folder" pid=924 storage=default gitlab # [ 10.290508] gitaly[924]: time="2026-08-15T23:41:15.582Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1571018947 pid=924 storage=default gitlab # [ 10.290935] gitaly[924]: time="2026-08-15T23:41:15.582Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1571018947 pid=924 storage=default gitlab # [ 10.291536] gitaly[924]: time="2026-08-15T23:41:15.582Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=924 gitlab # [ 10.291943] gitaly[924]: time="2026-08-15T23:41:15.582Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=924 gitlab # [ 10.292522] gitaly[924]: time="2026-08-15T23:41:15.582Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1571018947 clear_duration_ms=0 pid=924 storage=default gitlab # [ 10.323354] gitaly[924]: time="2026-08-15T23:41:15.616Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=924 gitlab # [ 10.325221] gitaly[924]: time="2026-08-15T23:41:15.616Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=924 schema=unix gitlab # [ 10.326873] gitaly[924]: time="2026-08-15T23:41:15.616Z" level=info msg="listening at address" address=/run/gitaly/gitaly-924/sock.d/intern pid=924 schema=unix gitlab # [ 10.328490] gitaly[924]: time="2026-08-15T23:41:15.617Z" level=info msg="finished tempdir cleaner walk" pid=924 storage=default time_ms=0 gitlab # [ 10.329854] gitaly[924]: time="2026-08-15T23:41:15.617Z" level=info msg="counting repositories" pid=924 gitlab # [ 10.330972] gitaly[924]: time="2026-08-15T23:41:15.617Z" level=info msg="starting to count repositories" pid=924 storage_path=/var/gitlab/state/repositories gitlab # [ 10.332648] gitaly[924]: time="2026-08-15T23:41:15.617Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=924 storage_path=/var/gitlab/state/repositories gitlab # [ 10.334532] gitaly[924]: time="2026-08-15T23:41:15.617Z" level=info msg="completed counting all repositories" counting_duration=0 pid=924 gitlab # [ 10.335965] gitaly[924]: time="2026-08-15T23:41:15.618Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=924 gitlab # [ 10.337626] gitaly[924]: time="2026-08-15T23:41:15.618Z" level=info msg="Started Gitaly" duration_ms=206 pid=924 gitlab # [ 10.339256] gitaly[924]: time="2026-08-15T23:41:15.618Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=924 gitlab # [ 10.339787] gitaly[924]: time="2026-08-15T23:41:15.620Z" level=info msg="maintenance: daily scheduled" pid=924 scheduled="2026-08-16 12:00:00 +0000 UTC" gitlab # [ 10.877402] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.883520] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.899599] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.222374] gitaly[924]: time="2026-08-15T23:41:17.514Z" level=info msg="License database preloaded" duration_ms=2102 pid=924 gitlab # [ 14.015777] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 14.016803] dhcpcd[767]: eth0: adding route to 10.0.2.0/24 gitlab # [ 14.017626] dhcpcd[767]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.121183] systemd[1]: Started DHCP Client. gitlab # [ 14.122785] systemd[1]: Reached target Network is Online. gitlab # [ 40.603733] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[927]: W, [2026-08-15T23:41:45.895955 #927] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 42.345220] postgres[1308]: [1308] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 42.347390] postgres[1308]: [1308] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 42.348336] postgres[1308]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 42.349743] postgres[1308]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 42.350872] postgres[1308]: attidentity AS identity, gitlab # [ 42.353090] postgres[1308]: attgenerated as attgenerated gitlab # [ 42.354492] postgres[1308]: FROM pg_attribute a gitlab # [ 42.356270] postgres[1308]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 42.358078] postgres[1308]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 42.359478] postgres[1308]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 42.361257] postgres[1308]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 42.362995] postgres[1308]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 42.364485] postgres[1308]: ORDER BY a.attnum gitlab # [ 42.366250] postgres[1308]: gitlab # [ 45.705687] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1341]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 45.706823] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1341]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.261095] gitlab-workhorse[824]: time="2026-08-15T23:41:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.271773] gitlab-workhorse[824]: time="2026-08-15T23:42:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 60.426084] postgres[1407]: [1407] ERROR: relation "table_without_models" does not exist gitlab # [ 60.427231] postgres[1407]: [1407] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.280551] gitlab-workhorse[824]: time="2026-08-15T23:42:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 72.950839] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 72.956787] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 72.962059] systemd[1]: Starting gitlab.service... gitlab # [ 73.326335] bundle[1583]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 73.330961] bundle[1583]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 73.335292] bundle[1583]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 76.022264] sidekiq-cluster[1582]: {"severity":"INFO","time":"2026-08-15T23:42:21.298Z","message":"Starting cluster with 1 processes"} gitlab # [ 76.116742] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.391Z","pid":1583,"message":"* Enabling systemd notification integration"} gitlab # [ 76.120351] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.408Z","pid":1583,"message":"Puma starting in cluster mode..."} gitlab # [ 76.123527] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.408Z","pid":1583,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 76.126908] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.408Z","pid":1583,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 76.131168] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.408Z","pid":1583,"message":"* Min threads: 0"} gitlab # [ 76.134153] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.408Z","pid":1583,"message":"* Max threads: 4"} gitlab # [ 76.137056] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.409Z","pid":1583,"message":"* Environment: production"} gitlab # [ 76.140163] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.409Z","pid":1583,"message":"* Master PID: 1583"} gitlab # [ 76.143214] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.409Z","pid":1583,"message":"* Workers: 2"} gitlab # [ 76.146099] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.409Z","pid":1583,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 76.149847] bundle[1583]: {"timestamp":"2026-08-15T23:42:21.409Z","pid":1583,"message":"* Preloading application"} gitlab # [ 78.289884] gitlab-workhorse[824]: time="2026-08-15T23:42:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 88.299855] gitlab-workhorse[824]: time="2026-08-15T23:42:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.301259] gitlab-workhorse[824]: time="2026-08-15T23:42:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.699981] bundle[1583]: W, [2026-08-15T23:42:43.992209 #1583] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 100.855099] sidekiq-cluster[1613]: 2026-08-15T23:42:46.147Z pid=1613 tid=wkl INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1613, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>442548224} gitlab # [ 101.025630] sidekiq-cluster[1613]: W, [2026-08-15T23:42:46.318558 #1613] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 101.064939] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:46.357Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 103.036105] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.328Z","message":"GitLab reliable fetch activated!"} gitlab # [ 103.037193] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.328Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 103.059052] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.352Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 103.061050] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.354Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 103.063248] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.356Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 103.065508] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.358Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 103.067948] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.360Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 103.070398] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.363Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 103.072460] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.365Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 103.074082] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.367Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 103.075641] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.368Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 103.077270] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.370Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 103.078796] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.371Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 103.081340] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.374Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 103.083567] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.376Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 103.085585] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.378Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 103.087258] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.380Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 103.089497] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.382Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 103.094477] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.387Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 103.100158] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.393Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 103.104899] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.397Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 103.109734] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.402Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 103.114137] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.407Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 103.117509] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.410Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 103.120964] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.413Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 103.124215] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.417Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 103.126588] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.419Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 103.130561] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.423Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 103.134453] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.427Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 103.138481] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.431Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 103.142167] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.435Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 103.145786] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.438Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 103.148881] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.441Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 103.152523] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.445Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 103.156370] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.449Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 103.160123] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.453Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 103.163315] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.456Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 103.166373] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.459Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 103.169582] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.462Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 103.172909] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.465Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 103.175947] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.468Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 103.178957] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.471Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 103.182486] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.475Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 103.185454] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.478Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 103.188515] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.481Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 103.191521] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.484Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 103.195171] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.488Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 103.198312] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.491Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 103.201090] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.494Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 103.204119] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.497Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 103.207325] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.500Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 103.210095] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.503Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 103.213496] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.506Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 103.216740] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.509Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 103.225958] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.518Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 103.229603] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.522Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 103.232975] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.526Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 103.236140] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.529Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 103.239480] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.532Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 103.243097] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.536Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 103.245748] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.538Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 103.248727] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.541Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 103.251967] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.545Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 103.254719] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.547Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 103.258107] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.551Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 103.261333] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.554Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 103.264471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.557Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 103.267903] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.560Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 103.270681] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.563Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 103.273193] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.566Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 103.275365] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.568Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 103.276544] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.569Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 103.278750] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.571Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 103.281120] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.574Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 103.283164] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.575Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 103.285229] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.577Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 103.287419] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.578Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 103.288163] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.581Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 103.290121] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.583Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 103.292351] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.585Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 103.294411] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.587Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 103.296462] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.589Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 103.298436] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.591Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 103.300765] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.593Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 103.303565] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.596Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 103.305672] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.598Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 103.307852] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.600Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 103.309773] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.602Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 103.312659] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.605Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 103.314803] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.607Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 103.317049] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.610Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 103.319174] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.612Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 103.321348] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.614Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 103.323298] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.616Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 103.325479] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.618Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 103.327486] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.620Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 103.330312] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.623Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 103.333256] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.626Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 103.335346] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.628Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 103.337381] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.630Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 103.347593] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.640Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 103.349640] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.642Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 103.352171] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.645Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 103.355379] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.648Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 103.358220] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.651Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 103.360954] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.654Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 103.363620] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.656Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 103.365869] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.658Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 103.368087] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.661Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 103.370925] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.664Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 103.373105] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:42:48.666Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 106.630789] sidekiq-cluster[1613]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 106.632300] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 106.633235] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 106.633947] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 106.634608] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 106.635655] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 106.636678] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 106.650587] sidekiq-cluster[1613]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 106.651589] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 106.652623] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 106.653743] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 106.654834] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 106.655946] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 106.657060] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 106.672867] sidekiq-cluster[1613]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 106.673549] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 106.674572] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 106.675269] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 106.675954] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 106.676987] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 106.678051] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 106.695653] sidekiq-cluster[1613]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 106.697145] sidekiq-cluster[1613]: FROM pg_type as t gitlab # [ 106.699125] sidekiq-cluster[1613]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 106.699988] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 106.701141] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 106.701693] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 106.702298] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 106.703651] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 106.704775] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 106.718598] sidekiq-cluster[1613]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 106.720762] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 106.723328] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 106.724108] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 106.724641] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 106.725075] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 106.725522] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 106.725972] sidekiq-cluster[1613]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics' gitlab # [ 106.726539] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 106.726958] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 106.727559] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 106.728149] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 106.728570] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start' gitlab # [ 106.728995] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 108.310856] gitlab-workhorse[824]: time="2026-08-15T23:42:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 118.320951] gitlab-workhorse[824]: time="2026-08-15T23:43:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.294779] postgres[2060]: [2060] ERROR: relation "table_without_models" does not exist gitlab # [ 128.296301] postgres[2060]: [2060] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 128.323504] gitlab-workhorse[824]: time="2026-08-15T23:43:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.343447] postgres[2071]: [2071] ERROR: relation "table_without_models" does not exist gitlab # [ 129.344592] postgres[2071]: [2071] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 130.887493] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:16.178Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 130.891284] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:16.181Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 130.891856] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:16.181Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 130.892900] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:16.181Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 130.903751] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:16.196Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 132.074374] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.366Z","pid":1583,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 132.076516] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.366Z","pid":1583,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 132.078278] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.366Z","pid":1583,"message":"! #\u003cThread:0x0000770c8a845fe0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 132.079411] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.366Z","pid":1583,"message":"! #\u003cThread:0x0000770c8aa91560 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 132.080432] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.366Z","pid":1583,"message":"Use Ctrl-C to stop"} gitlab # [ 132.081464] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.367Z","pid":1583,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 132.270030] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:17.562Z","message":"Cleaning working queues"} gitlab # [ 132.271909] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:17.564Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"12c3602c83d10a437cf3ee0b","created_at":"2026-08-15T23:42:17.848Z","trace_propagation_headers":{"sentry-trace":"df9fb61472c344a799f490d579eb8075-d5a7908d836a4a5e","baggage":"sentry-trace_id=df9fb61472c344a799f490d579eb8075,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"692af97f3502fe1c5d014e922e1694bc","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:42:17.855Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-12c3602c83d10a437cf3ee0b: start","job_status":"start","queue_duration_s":59.709182,"scheduling_latency_s":59.709221} gitlab # [ 132.399560] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:17.692Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"12c3602c83d10a437cf3ee0b","created_at":"2026-08-15T23:42:17.848Z","trace_propagation_headers":{"sentry-trace":"df9fb61472c344a799f490d579eb8075-d5a7908d836a4a5e","baggage":"sentry-trace_id=df9fb61472c344a799f490d579eb8075,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"692af97f3502fe1c5d014e922e1694bc","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:42:17.855Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-12c3602c83d10a437cf3ee0b: done: 0.127642 sec","job_status":"done","queue_duration_s":59.709182,"scheduling_latency_s":59.709221,"redis_calls":26,"redis_duration_s":0.003788,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.001994,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06917611000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.127642,"completed_at":"2026-08-15T23:43:17.692Z","load_balancing_strategy":"primary","db_duration_s":0.032733,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 132.412772] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.705Z","pid":1583,"message":"- Worker 1 (PID: 2160) booted in 0.26s, phase: 0"} gitlab # [ 132.442142] bundle[1583]: {"timestamp":"2026-08-15T23:43:17.735Z","pid":1583,"message":"- Worker 0 (PID: 2156) booted in 0.31s, phase: 0"} gitlab # [ 132.445392] systemd[1]: Started gitlab.service. gitlab # [ 132.446066] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 132.447352] systemd[1]: Starting setup-gitlab.service... gitlab # [ 132.467104] setup-gitlab-start[2200]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 134.855813] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:43:20 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2368 gitlab # [ 134.860691] setup-gitlab-start[2200]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 134.863256] setup-gitlab-start[2200]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 134.874663] runuser[2218]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 135.265375] setup-gitlab-start[2219]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.270084] setup-gitlab-start[2219]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.274638] setup-gitlab-start[2219]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.842277] setup-gitlab-start[2219]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.846982] setup-gitlab-start[2219]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.851451] setup-gitlab-start[2219]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 143.280886] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:28.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c9d1d95f57b44689b7ef0b89","created_at":"2026-08-15T23:43:28.538Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cce1f498752c2b10d0ad5ae30f66004e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.570Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c9d1d95f57b44689b7ef0b89: start","job_status":"start","queue_duration_s":0.00253,"scheduling_latency_s":0.002581} gitlab # [ 143.783511] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c9d1d95f57b44689b7ef0b89","created_at":"2026-08-15T23:43:28.538Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cce1f498752c2b10d0ad5ae30f66004e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.570Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c9d1d95f57b44689b7ef0b89: done: 0.503247 sec","job_status":"done","queue_duration_s":0.00253,"scheduling_latency_s":0.002581,"redis_calls":14,"redis_duration_s":0.01848,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.011744,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003132,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.069,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.218133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002021486,"exclusive_lock_hold_duration_s":0.403001219,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.503247,"completed_at":"2026-08-15T23:43:29.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.170852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.819293] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b318ac201360f3596191befd","created_at":"2026-08-15T23:43:28.578Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99b321c3de7f820a9a9401fb398ecd2f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.588Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b318ac201360f3596191befd: start","job_status":"start","queue_duration_s":0.489175,"scheduling_latency_s":0.48919} gitlab # [ 143.830180] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b318ac201360f3596191befd","created_at":"2026-08-15T23:43:28.578Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99b321c3de7f820a9a9401fb398ecd2f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.588Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b318ac201360f3596191befd: done: 0.041861 sec","job_status":"done","queue_duration_s":0.489175,"scheduling_latency_s":0.48919,"redis_calls":12,"redis_duration_s":0.002914,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000452013,"exclusive_lock_hold_duration_s":0.012432585999999999,"duration_s":0.041861,"completed_at":"2026-08-15T23:43:29.119Z","load_balancing_strategy":"primary","db_duration_s":0.015113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.863119] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8a714d41170a2a2fee934cb4","created_at":"2026-08-15T23:43:28.622Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cdc1aa56d9823a86e76668feb847397","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.639Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8a714d41170a2a2fee934cb4: start","job_status":"start","queue_duration_s":0.481218,"scheduling_latency_s":0.481233} gitlab # [ 143.874865] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8a714d41170a2a2fee934cb4","created_at":"2026-08-15T23:43:28.622Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cdc1aa56d9823a86e76668feb847397","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.639Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8a714d41170a2a2fee934cb4: done: 0.030531 sec","job_status":"done","queue_duration_s":0.481218,"scheduling_latency_s":0.481233,"redis_calls":12,"redis_duration_s":0.002666,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000381334,"exclusive_lock_hold_duration_s":0.016452928,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.030531,"completed_at":"2026-08-15T23:43:29.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.910404] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3ce16f5a9ed6faa7e9e6e062","created_at":"2026-08-15T23:43:28.658Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9d8546498717feaaef21147a44f016d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:43:28.669Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3ce16f5a9ed6faa7e9e6e062: start","job_status":"start","queue_duration_s":0.483856,"scheduling_latency_s":0.48387} gitlab # [ 143.922692] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.161Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 143.923693] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3ce16f5a9ed6faa7e9e6e062","created_at":"2026-08-15T23:43:28.658Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9d8546498717feaaef21147a44f016d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:43:28.669Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3ce16f5a9ed6faa7e9e6e062: done: 0.013235 sec","job_status":"done","queue_duration_s":0.483856,"scheduling_latency_s":0.48387,"redis_calls":10,"redis_duration_s":0.002112,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279085,"duration_s":0.013235,"completed_at":"2026-08-15T23:43:29.166Z","load_balancing_strategy":"primary","db_duration_s":0.000508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.924994] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9475e2ffa7d038ca57bfea0b","created_at":"2026-08-15T23:43:28.700Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eec1c519586b25ca44ff8df8fd6941d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.709Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9475e2ffa7d038ca57bfea0b: start","job_status":"start","queue_duration_s":0.458249,"scheduling_latency_s":0.458263} gitlab # [ 143.936569] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9475e2ffa7d038ca57bfea0b","created_at":"2026-08-15T23:43:28.700Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2eec1c519586b25ca44ff8df8fd6941d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.709Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9475e2ffa7d038ca57bfea0b: done: 0.016795 sec","job_status":"done","queue_duration_s":0.458249,"scheduling_latency_s":0.458263,"redis_calls":12,"redis_duration_s":0.002686,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000360661,"exclusive_lock_hold_duration_s":0.0032420319999999997,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016795,"completed_at":"2026-08-15T23:43:29.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.990224] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aefe2579488462a92afa5d6f","created_at":"2026-08-15T23:43:28.713Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"213776151b01b7d1e6245c5899afb051","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:43:28.721Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aefe2579488462a92afa5d6f: start","job_status":"start","queue_duration_s":0.464087,"scheduling_latency_s":0.4641} gitlab # [ 143.990770] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.193Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 143.991522] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aefe2579488462a92afa5d6f","created_at":"2026-08-15T23:43:28.713Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"213776151b01b7d1e6245c5899afb051","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:43:28.721Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aefe2579488462a92afa5d6f: done: 0.01296 sec","job_status":"done","queue_duration_s":0.464087,"scheduling_latency_s":0.4641,"redis_calls":10,"redis_duration_s":0.002109,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000270984,"duration_s":0.01296,"completed_at":"2026-08-15T23:43:29.198Z","load_balancing_strategy":"primary","db_duration_s":0.000413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.029928] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"df978ee49ae247b856feb6f1","created_at":"2026-08-15T23:43:28.731Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699949f856619775d215ec3204580545","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.737Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-df978ee49ae247b856feb6f1: start","job_status":"start","queue_duration_s":0.461904,"scheduling_latency_s":0.461917} gitlab # [ 144.073094] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"df978ee49ae247b856feb6f1","created_at":"2026-08-15T23:43:28.731Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699949f856619775d215ec3204580545","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.737Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-df978ee49ae247b856feb6f1: done: 0.16561 sec","job_status":"done","queue_duration_s":0.461904,"scheduling_latency_s":0.461917,"redis_calls":10,"redis_duration_s":0.114399,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.113497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000880559,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.16561,"completed_at":"2026-08-15T23:43:29.365Z","load_balancing_strategy":"primary","db_duration_s":0.031641,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.109236] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.401Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"45531a57222ff10715f61b37","created_at":"2026-08-15T23:43:28.748Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"badb535e03cb993d7a49331f505344d0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.755Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-45531a57222ff10715f61b37: start","job_status":"start","queue_duration_s":0.646483,"scheduling_latency_s":0.646536} gitlab # [ 144.178927] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"45531a57222ff10715f61b37","created_at":"2026-08-15T23:43:28.748Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"badb535e03cb993d7a49331f505344d0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.755Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-45531a57222ff10715f61b37: done: 0.069812 sec","job_status":"done","queue_duration_s":0.646483,"scheduling_latency_s":0.646536,"redis_calls":16,"redis_duration_s":0.003819,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002028,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040927,"duration_s":0.069812,"completed_at":"2026-08-15T23:43:29.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.180810] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e1984ed3082c0dcf23b10a5d","created_at":"2026-08-15T23:43:28.759Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46470585155973d5da0c8e45e324ce29","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.767Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e1984ed3082c0dcf23b10a5d: start","job_status":"start","queue_duration_s":0.705591,"scheduling_latency_s":0.705618} gitlab # [ 144.218565] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e1984ed3082c0dcf23b10a5d","created_at":"2026-08-15T23:43:28.759Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46470585155973d5da0c8e45e324ce29","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.767Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e1984ed3082c0dcf23b10a5d: done: 0.037944 sec","job_status":"done","queue_duration_s":0.705591,"scheduling_latency_s":0.705618,"redis_calls":12,"redis_duration_s":0.002763,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000465981,"exclusive_lock_hold_duration_s":0.014578388999999999,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.037944,"completed_at":"2026-08-15T23:43:29.511Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.226114] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"db8c02321dbd6c97c6c44ff0","created_at":"2026-08-15T23:43:28.772Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.779Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-db8c02321dbd6c97c6c44ff0: start","job_status":"start","queue_duration_s":0.737908,"scheduling_latency_s":0.737924} gitlab # [ 144.256500] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.549Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"db8c02321dbd6c97c6c44ff0","created_at":"2026-08-15T23:43:28.772Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.779Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-db8c02321dbd6c97c6c44ff0: done: 0.031575 sec","job_status":"done","queue_duration_s":0.737908,"scheduling_latency_s":0.737924,"redis_calls":19,"redis_duration_s":0.006505,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001289,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000285,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003526,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280761,"duration_s":0.031575,"completed_at":"2026-08-15T23:43:29.549Z","load_balancing_strategy":"primary","db_duration_s":0.004886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.297933] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a20115aadfae5d3fa91beea7","created_at":"2026-08-15T23:43:28.793Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c5dc54c1dc43df131d9fd8750b8c611","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a20115aadfae5d3fa91beea7: start","job_status":"start","queue_duration_s":0.748343,"scheduling_latency_s":0.748358} gitlab # [ 144.298657] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a20115aadfae5d3fa91beea7","created_at":"2026-08-15T23:43:28.793Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c5dc54c1dc43df131d9fd8750b8c611","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a20115aadfae5d3fa91beea7: done: 0.0188 sec","job_status":"done","queue_duration_s":0.748343,"scheduling_latency_s":0.748358,"redis_calls":10,"redis_duration_s":0.002306,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000287187,"duration_s":0.0188,"completed_at":"2026-08-15T23:43:29.574Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.316129] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"abed5f4a6fa9e821518b629c","created_at":"2026-08-15T23:43:28.817Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77a3c4f2a35029adfd10d0c6785aff55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.827Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-abed5f4a6fa9e821518b629c: start","job_status":"start","queue_duration_s":0.7494,"scheduling_latency_s":0.749449} gitlab # [ 144.360915] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.595Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 144.361544] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"abed5f4a6fa9e821518b629c","created_at":"2026-08-15T23:43:28.817Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77a3c4f2a35029adfd10d0c6785aff55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.827Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-abed5f4a6fa9e821518b629c: done: 0.023308 sec","job_status":"done","queue_duration_s":0.7494,"scheduling_latency_s":0.749449,"redis_calls":10,"redis_duration_s":0.003729,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003046,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000402,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000241651,"duration_s":0.023308,"completed_at":"2026-08-15T23:43:29.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001835,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.363807] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c63325968be1a0cebe064768","created_at":"2026-08-15T23:43:28.834Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c187fc12fc3d96c38d853cffb15cecf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.843Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c63325968be1a0cebe064768: start","job_status":"start","queue_duration_s":0.756967,"scheduling_latency_s":0.75698} gitlab # [ 144.404229] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c63325968be1a0cebe064768","created_at":"2026-08-15T23:43:28.834Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c187fc12fc3d96c38d853cffb15cecf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.843Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c63325968be1a0cebe064768: done: 0.013243 sec","job_status":"done","queue_duration_s":0.756967,"scheduling_latency_s":0.75698,"redis_calls":12,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203937,"duration_s":0.013243,"completed_at":"2026-08-15T23:43:29.613Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.408970] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"d443c9b35cc287f5c72ad400","created_at":"2026-08-15T23:43:28.859Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecf48e8393e171c14b251dd83ad34f5c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.868Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-d443c9b35cc287f5c72ad400: start","job_status":"start","queue_duration_s":0.746256,"scheduling_latency_s":0.746269} gitlab # [ 144.419501] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"d443c9b35cc287f5c72ad400","created_at":"2026-08-15T23:43:28.859Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecf48e8393e171c14b251dd83ad34f5c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.868Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-d443c9b35cc287f5c72ad400: done: 0.018591 sec","job_status":"done","queue_duration_s":0.746256,"scheduling_latency_s":0.746269,"redis_calls":12,"redis_duration_s":0.001599,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000293334,"exclusive_lock_hold_duration_s":0.006356116,"duration_s":0.018591,"completed_at":"2026-08-15T23:43:29.633Z","load_balancing_strategy":"primary","db_duration_s":0.002325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.470268] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3afafc8a9c97260ad06943f4","created_at":"2026-08-15T23:43:28.876Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dda26ef6aa1d7e6256837ddf2419eb20","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.884Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3afafc8a9c97260ad06943f4: start","job_status":"start","queue_duration_s":0.750135,"scheduling_latency_s":0.750148} gitlab # [ 144.597586] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3afafc8a9c97260ad06943f4","created_at":"2026-08-15T23:43:28.876Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dda26ef6aa1d7e6256837ddf2419eb20","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.884Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3afafc8a9c97260ad06943f4: done: 0.256006 sec","job_status":"done","queue_duration_s":0.750135,"scheduling_latency_s":0.750148,"redis_calls":565,"redis_duration_s":0.092506,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.091432,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.187164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224888,"duration_s":0.256006,"completed_at":"2026-08-15T23:43:29.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.632441] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b8208b8f49b1a6b41486173c","created_at":"2026-08-15T23:43:28.890Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3ea96cd6a2887df5640f9b746c316b9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.898Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b8208b8f49b1a6b41486173c: start","job_status":"start","queue_duration_s":1.026617,"scheduling_latency_s":1.026665} gitlab # [ 144.666436] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b8208b8f49b1a6b41486173c","created_at":"2026-08-15T23:43:28.890Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3ea96cd6a2887df5640f9b746c316b9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.898Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b8208b8f49b1a6b41486173c: done: 0.033918 sec","job_status":"done","queue_duration_s":1.026617,"scheduling_latency_s":1.026665,"redis_calls":13,"redis_duration_s":0.0018670000000000002,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007082744,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033918,"completed_at":"2026-08-15T23:43:29.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003074,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 144.703072] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:29.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8f24f6be248517152b2e8d88","created_at":"2026-08-15T23:43:28.905Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3d31c553e6c0dc8b124af3624a570ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.912Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8f24f6be248517152b2e8d88: start","job_status":"start","queue_duration_s":1.083455,"scheduling_latency_s":1.083479} gitlab # [ 144.723656] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.016Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 144.729070] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.021Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8f24f6be248517152b2e8d88","created_at":"2026-08-15T23:43:28.905Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3d31c553e6c0dc8b124af3624a570ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.912Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8f24f6be248517152b2e8d88: done: 0.026266 sec","job_status":"done","queue_duration_s":1.083455,"scheduling_latency_s":1.083479,"redis_calls":10,"redis_duration_s":0.002175,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274057,"duration_s":0.026266,"completed_at":"2026-08-15T23:43:30.021Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.748629] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f05a4cfb47b346aeb7d31e91","created_at":"2026-08-15T23:43:28.924Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6559ea2c7175f8c9efce49246c951367","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.931Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f05a4cfb47b346aeb7d31e91: start","job_status":"start","queue_duration_s":1.092236,"scheduling_latency_s":1.092249} gitlab # [ 144.749284] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.036Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f05a4cfb47b346aeb7d31e91","created_at":"2026-08-15T23:43:28.924Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6559ea2c7175f8c9efce49246c951367","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.931Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f05a4cfb47b346aeb7d31e91: done: 0.013161 sec","job_status":"done","queue_duration_s":1.092236,"scheduling_latency_s":1.092249,"redis_calls":10,"redis_duration_s":0.002265,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000301994,"duration_s":0.013161,"completed_at":"2026-08-15T23:43:30.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.803630] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4135ad7b4ad2360b22e95452","created_at":"2026-08-15T23:43:28.953Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1cbd177c6126e2f345a32524303100a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.966Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4135ad7b4ad2360b22e95452: start","job_status":"start","queue_duration_s":1.071652,"scheduling_latency_s":1.071666} gitlab # [ 144.832317] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.125Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 144.843882] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4135ad7b4ad2360b22e95452","created_at":"2026-08-15T23:43:28.953Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1cbd177c6126e2f345a32524303100a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.966Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4135ad7b4ad2360b22e95452: done: 0.098617 sec","job_status":"done","queue_duration_s":1.071652,"scheduling_latency_s":1.071666,"redis_calls":10,"redis_duration_s":0.075761,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000786,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.073144,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000460953,"duration_s":0.098617,"completed_at":"2026-08-15T23:43:30.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.880090] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9a79a1a0dffb7d2d2ded577c","created_at":"2026-08-15T23:43:28.978Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.984Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9a79a1a0dffb7d2d2ded577c: start","job_status":"start","queue_duration_s":1.188377,"scheduling_latency_s":1.188418} gitlab # [ 145.015652] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9a79a1a0dffb7d2d2ded577c","created_at":"2026-08-15T23:43:28.978Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:28.984Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9a79a1a0dffb7d2d2ded577c: done: 0.135757 sec","job_status":"done","queue_duration_s":1.188377,"scheduling_latency_s":1.188418,"redis_calls":71,"redis_duration_s":0.017566,"redis_read_bytes":120,"redis_write_bytes":42524,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00187,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000865,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37335,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014268,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000502578,"duration_s":0.135757,"completed_at":"2026-08-15T23:43:30.308Z","load_balancing_strategy":"primary","db_duration_s":0.00318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.086072] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f6151ccc87675091f202f517","created_at":"2026-08-15T23:43:28.994Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5af5df9c1aec0d2e3d092d2a840ed34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.003Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f6151ccc87675091f202f517: start","job_status":"start","queue_duration_s":1.375582,"scheduling_latency_s":1.375614} gitlab # [ 145.111298] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.404Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 145.121259] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f6151ccc87675091f202f517","created_at":"2026-08-15T23:43:28.994Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5af5df9c1aec0d2e3d092d2a840ed34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.003Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f6151ccc87675091f202f517: done: 0.035157 sec","job_status":"done","queue_duration_s":1.375582,"scheduling_latency_s":1.375614,"redis_calls":10,"redis_duration_s":0.002337,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000436927,"duration_s":0.035157,"completed_at":"2026-08-15T23:43:30.413Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.157170] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e71ef52c528d6efe28c28d50","created_at":"2026-08-15T23:43:29.010Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92ee7a9e39b5e60b4596ba326d850b3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:43:29.019Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e71ef52c528d6efe28c28d50: start","job_status":"start","queue_duration_s":1.430733,"scheduling_latency_s":1.430767} gitlab # [ 145.213944] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e71ef52c528d6efe28c28d50","created_at":"2026-08-15T23:43:29.010Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92ee7a9e39b5e60b4596ba326d850b3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:43:29.019Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e71ef52c528d6efe28c28d50: done: 0.056762 sec","job_status":"done","queue_duration_s":1.430733,"scheduling_latency_s":1.430767,"redis_calls":10,"redis_duration_s":0.002123,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000450896,"duration_s":0.056762,"completed_at":"2026-08-15T23:43:30.506Z","load_balancing_strategy":"primary","db_duration_s":0.006156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.258163] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.550Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0bfe8b8a9dea4213f34f7591","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0bfe8b8a9dea4213f34f7591: start","job_status":"start","queue_duration_s":1.00693,"scheduling_latency_s":1.006966} gitlab # [ 145.284947] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.577Z","message":"No existing merge request to be cleaned up."} gitlab # [ 145.306554] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.598Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0bfe8b8a9dea4213f34f7591","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0bfe8b8a9dea4213f34f7591: done: 0.047524 sec","job_status":"done","queue_duration_s":1.00693,"scheduling_latency_s":1.006966,"redis_calls":13,"redis_duration_s":0.005457,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000634,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003557,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000468216,"duration_s":0.047524,"completed_at":"2026-08-15T23:43:30.598Z","load_balancing_strategy":"primary","db_duration_s":0.005196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.345483] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.638Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24f05aab9f3e51b768908dcb","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24f05aab9f3e51b768908dcb: start","job_status":"start","queue_duration_s":1.094278,"scheduling_latency_s":1.094321} gitlab # [ 145.365626] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.658Z","message":"No existing merge request to be cleaned up."} gitlab # [ 145.379118] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.671Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"24f05aab9f3e51b768908dcb","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-24f05aab9f3e51b768908dcb: done: 0.033626 sec","job_status":"done","queue_duration_s":1.094278,"scheduling_latency_s":1.094321,"redis_calls":10,"redis_duration_s":0.004254,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003194,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033626,"completed_at":"2026-08-15T23:43:30.671Z","load_balancing_strategy":"primary","db_duration_s":0.004621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.412415] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.705Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce3bed28db1ec6993d188670","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce3bed28db1ec6993d188670: start","job_status":"start","queue_duration_s":1.161279,"scheduling_latency_s":1.161312} gitlab # [ 145.441263] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.734Z","message":"No existing merge request to be cleaned up."} gitlab # [ 145.455831] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.748Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce3bed28db1ec6993d188670","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce3bed28db1ec6993d188670: done: 0.04329 sec","job_status":"done","queue_duration_s":1.161279,"scheduling_latency_s":1.161312,"redis_calls":10,"redis_duration_s":0.005072,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003563,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04329,"completed_at":"2026-08-15T23:43:30.748Z","load_balancing_strategy":"primary","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.489525] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.781Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"57397f8246873222c44c10ee","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-57397f8246873222c44c10ee: start","job_status":"start","queue_duration_s":1.237884,"scheduling_latency_s":1.237929} gitlab # [ 145.507400] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.800Z","message":"No existing merge request to be cleaned up."} gitlab # [ 145.520806] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.813Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"57397f8246873222c44c10ee","created_at":"2026-08-15T23:43:29.535Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-a0baef7b36644685","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4849b7f8b48cd2a9e4681b6c121126ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:29.543Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-57397f8246873222c44c10ee: done: 0.031737 sec","job_status":"done","queue_duration_s":1.237884,"scheduling_latency_s":1.237929,"redis_calls":10,"redis_duration_s":0.003958,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002805,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031737,"completed_at":"2026-08-15T23:43:30.813Z","load_balancing_strategy":"primary","db_duration_s":0.002669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.554451] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7ee4abbbb1707840fc72b8","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7ee4abbbb1707840fc72b8: start","job_status":"start","queue_duration_s":0.546131,"scheduling_latency_s":0.546174} gitlab # [ 145.597071] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af7ee4abbbb1707840fc72b8","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af7ee4abbbb1707840fc72b8: done: 0.042426 sec","job_status":"done","queue_duration_s":0.546131,"scheduling_latency_s":0.546174,"redis_calls":16,"redis_duration_s":0.003283,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000421003,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042426,"completed_at":"2026-08-15T23:43:30.889Z","load_balancing_strategy":"primary","db_duration_s":0.000853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.629923] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb04df543f25cc928df0de29","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb04df543f25cc928df0de29: start","job_status":"start","queue_duration_s":0.593953,"scheduling_latency_s":0.593979} gitlab # [ 145.639907] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb04df543f25cc928df0de29","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb04df543f25cc928df0de29: done: 0.027027 sec","job_status":"done","queue_duration_s":0.593953,"scheduling_latency_s":0.593979,"redis_calls":13,"redis_duration_s":0.004037,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027027,"completed_at":"2026-08-15T23:43:30.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.671259] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dce3517fec617a97b83d4a6","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dce3517fec617a97b83d4a6: start","job_status":"start","queue_duration_s":0.623477,"scheduling_latency_s":0.623564} gitlab # [ 145.681226] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dce3517fec617a97b83d4a6","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dce3517fec617a97b83d4a6: done: 0.018904 sec","job_status":"done","queue_duration_s":0.623477,"scheduling_latency_s":0.623564,"redis_calls":13,"redis_duration_s":0.002604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018904,"completed_at":"2026-08-15T23:43:30.942Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.712176] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19dc3e47d48bfdaf2aca5d9d","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19dc3e47d48bfdaf2aca5d9d: start","job_status":"start","queue_duration_s":0.64404,"scheduling_latency_s":0.644065} gitlab # [ 145.722176] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19dc3e47d48bfdaf2aca5d9d","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19dc3e47d48bfdaf2aca5d9d: done: 0.01482 sec","job_status":"done","queue_duration_s":0.64404,"scheduling_latency_s":0.644065,"redis_calls":13,"redis_duration_s":0.001968,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01482,"completed_at":"2026-08-15T23:43:30.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.741647] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1bbad933425ecd4c13a204","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1bbad933425ecd4c13a204: start","job_status":"start","queue_duration_s":0.659791,"scheduling_latency_s":0.659806} gitlab # [ 145.742269] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1bbad933425ecd4c13a204","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1bbad933425ecd4c13a204: done: 0.009452 sec","job_status":"done","queue_duration_s":0.659791,"scheduling_latency_s":0.659806,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009452,"completed_at":"2026-08-15T23:43:30.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.787242] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3736aaea22bee8a2f7633739","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3736aaea22bee8a2f7633739: start","job_status":"start","queue_duration_s":0.670192,"scheduling_latency_s":0.670205} gitlab # [ 145.787908] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3736aaea22bee8a2f7633739","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3736aaea22bee8a2f7633739: done: 0.009188 sec","job_status":"done","queue_duration_s":0.670192,"scheduling_latency_s":0.670205,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009188,"completed_at":"2026-08-15T23:43:30.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.824175] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40940abeeb7bbe0e4a04c13b","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40940abeeb7bbe0e4a04c13b: start","job_status":"start","queue_duration_s":0.680151,"scheduling_latency_s":0.680163} gitlab # [ 145.824897] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40940abeeb7bbe0e4a04c13b","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40940abeeb7bbe0e4a04c13b: done: 0.009536 sec","job_status":"done","queue_duration_s":0.680151,"scheduling_latency_s":0.680163,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009536,"completed_at":"2026-08-15T23:43:30.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.840852] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:30.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5980bf8155887b667d9a69d0","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5980bf8155887b667d9a69d0: start","job_status":"start","queue_duration_s":0.690462,"scheduling_latency_s":0.690475} gitlab # [ 145.884069] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5980bf8155887b667d9a69d0","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5980bf8155887b667d9a69d0: done: 0.009425 sec","job_status":"done","queue_duration_s":0.690462,"scheduling_latency_s":0.690475,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009425,"completed_at":"2026-08-15T23:43:31.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.885207] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82d4ce673ede5715076b14b4","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82d4ce673ede5715076b14b4: start","job_status":"start","queue_duration_s":0.700737,"scheduling_latency_s":0.700751} gitlab # [ 145.891731] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82d4ce673ede5715076b14b4","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82d4ce673ede5715076b14b4: done: 0.013604 sec","job_status":"done","queue_duration_s":0.700737,"scheduling_latency_s":0.700751,"redis_calls":13,"redis_duration_s":0.0020369999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013604,"completed_at":"2026-08-15T23:43:31.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.923760] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5068db412426f346ac360bb5","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5068db412426f346ac360bb5: start","job_status":"start","queue_duration_s":0.715423,"scheduling_latency_s":0.715445} gitlab # [ 145.933686] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5068db412426f346ac360bb5","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5068db412426f346ac360bb5: done: 0.010512 sec","job_status":"done","queue_duration_s":0.715423,"scheduling_latency_s":0.715445,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010512,"completed_at":"2026-08-15T23:43:31.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.986236] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d5ff2c34d50b20a1d424d2f","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d5ff2c34d50b20a1d424d2f: start","job_status":"start","queue_duration_s":0.726738,"scheduling_latency_s":0.726752} gitlab # [ 146.015933] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d5ff2c34d50b20a1d424d2f","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d5ff2c34d50b20a1d424d2f: done: 0.281038 sec","job_status":"done","queue_duration_s":0.726738,"scheduling_latency_s":0.726752,"redis_calls":13,"redis_duration_s":0.270514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.269852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.281038,"completed_at":"2026-08-15T23:43:31.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.048210] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fb90b689f1cabdb61180950","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fb90b689f1cabdb61180950: start","job_status":"start","queue_duration_s":1.040354,"scheduling_latency_s":1.040381} gitlab # [ 146.078658] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fb90b689f1cabdb61180950","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fb90b689f1cabdb61180950: done: 0.029686 sec","job_status":"done","queue_duration_s":1.040354,"scheduling_latency_s":1.040381,"redis_calls":13,"redis_duration_s":0.003055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029686,"completed_at":"2026-08-15T23:43:31.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.111475] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe7aadde04215946d1c8c72","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe7aadde04215946d1c8c72: start","job_status":"start","queue_duration_s":1.103361,"scheduling_latency_s":1.103404} gitlab # [ 146.145475] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffe7aadde04215946d1c8c72","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffe7aadde04215946d1c8c72: done: 0.033444 sec","job_status":"done","queue_duration_s":1.103361,"scheduling_latency_s":1.103404,"redis_calls":13,"redis_duration_s":0.0025659999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033444,"completed_at":"2026-08-15T23:43:31.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.178962] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c3ce202a4952efec673e00","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c3ce202a4952efec673e00: start","job_status":"start","queue_duration_s":1.170868,"scheduling_latency_s":1.170908} gitlab # [ 146.203439] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c3ce202a4952efec673e00","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c3ce202a4952efec673e00: done: 0.024102 sec","job_status":"done","queue_duration_s":1.170868,"scheduling_latency_s":1.170908,"redis_calls":13,"redis_duration_s":0.003631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002467,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024102,"completed_at":"2026-08-15T23:43:31.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.239234] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e10f2ea1fa88f64e57721bb","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e10f2ea1fa88f64e57721bb: start","job_status":"start","queue_duration_s":1.231081,"scheduling_latency_s":1.23112} gitlab # [ 146.263617] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e10f2ea1fa88f64e57721bb","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e10f2ea1fa88f64e57721bb: done: 0.024071 sec","job_status":"done","queue_duration_s":1.231081,"scheduling_latency_s":1.23112,"redis_calls":13,"redis_duration_s":0.0041670000000000006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002549,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024071,"completed_at":"2026-08-15T23:43:31.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.297859] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"065f38498851be5bb674a6de","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-065f38498851be5bb674a6de: start","job_status":"start","queue_duration_s":1.289665,"scheduling_latency_s":1.289705} gitlab # [ 146.329650] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"065f38498851be5bb674a6de","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-065f38498851be5bb674a6de: done: 0.03091 sec","job_status":"done","queue_duration_s":1.289665,"scheduling_latency_s":1.289705,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03091,"completed_at":"2026-08-15T23:43:31.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.362713] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af914612eb84aa3dd28b9cb2","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af914612eb84aa3dd28b9cb2: start","job_status":"start","queue_duration_s":1.354379,"scheduling_latency_s":1.354434} gitlab # [ 146.394485] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af914612eb84aa3dd28b9cb2","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af914612eb84aa3dd28b9cb2: done: 0.031876 sec","job_status":"done","queue_duration_s":1.354379,"scheduling_latency_s":1.354434,"redis_calls":13,"redis_duration_s":0.002739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031876,"completed_at":"2026-08-15T23:43:31.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.427898] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7914a3103107b4b3c98d0623","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7914a3103107b4b3c98d0623: start","job_status":"start","queue_duration_s":1.419738,"scheduling_latency_s":1.419781} gitlab # [ 146.452494] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7914a3103107b4b3c98d0623","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7914a3103107b4b3c98d0623: done: 0.02478 sec","job_status":"done","queue_duration_s":1.419738,"scheduling_latency_s":1.419781,"redis_calls":13,"redis_duration_s":0.003994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002663,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02478,"completed_at":"2026-08-15T23:43:31.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.486910] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4393d63530d8356e6b26754b","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4393d63530d8356e6b26754b: start","job_status":"start","queue_duration_s":1.478547,"scheduling_latency_s":1.47859} gitlab # [ 146.517911] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4393d63530d8356e6b26754b","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4393d63530d8356e6b26754b: done: 0.0313 sec","job_status":"done","queue_duration_s":1.478547,"scheduling_latency_s":1.47859,"redis_calls":13,"redis_duration_s":0.0027359999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0313,"completed_at":"2026-08-15T23:43:31.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.549873] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9eaab1eedca0d9f92449f067","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9eaab1eedca0d9f92449f067: start","job_status":"start","queue_duration_s":1.511961,"scheduling_latency_s":1.511993} gitlab # [ 146.550471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9eaab1eedca0d9f92449f067","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9eaab1eedca0d9f92449f067: done: 0.020521 sec","job_status":"done","queue_duration_s":1.511961,"scheduling_latency_s":1.511993,"redis_calls":13,"redis_duration_s":0.0036639999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020521,"completed_at":"2026-08-15T23:43:31.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.585476] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f697c231540006481e04a1c0","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f697c231540006481e04a1c0: start","job_status":"start","queue_duration_s":1.534203,"scheduling_latency_s":1.534228} gitlab # [ 146.611610] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f697c231540006481e04a1c0","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f697c231540006481e04a1c0: done: 0.069131 sec","job_status":"done","queue_duration_s":1.534203,"scheduling_latency_s":1.534228,"redis_calls":13,"redis_duration_s":0.003476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002479,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.069131,"completed_at":"2026-08-15T23:43:31.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.645617] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37995f3e08ac129565c7b704","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37995f3e08ac129565c7b704: start","job_status":"start","queue_duration_s":1.637357,"scheduling_latency_s":1.637407} gitlab # [ 146.681931] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:31.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37995f3e08ac129565c7b704","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37995f3e08ac129565c7b704: done: 0.036467 sec","job_status":"done","queue_duration_s":1.637357,"scheduling_latency_s":1.637407,"redis_calls":13,"redis_duration_s":0.006957,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036467,"completed_at":"2026-08-15T23:43:31.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.715942] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"919c2d01d395f7375305d433","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-919c2d01d395f7375305d433: start","job_status":"start","queue_duration_s":1.707414,"scheduling_latency_s":1.707455} gitlab # [ 146.742596] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"919c2d01d395f7375305d433","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-919c2d01d395f7375305d433: done: 0.02702 sec","job_status":"done","queue_duration_s":1.707414,"scheduling_latency_s":1.707455,"redis_calls":13,"redis_duration_s":0.005937,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02702,"completed_at":"2026-08-15T23:43:32.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.745742] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93411163893e4209511c9334","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93411163893e4209511c9334: start","job_status":"start","queue_duration_s":1.737439,"scheduling_latency_s":1.737469} gitlab # [ 146.767293] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93411163893e4209511c9334","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93411163893e4209511c9334: done: 0.021789 sec","job_status":"done","queue_duration_s":1.737439,"scheduling_latency_s":1.737469,"redis_calls":13,"redis_duration_s":0.003268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021789,"completed_at":"2026-08-15T23:43:32.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.780920] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d546b32043082a706886fee","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d546b32043082a706886fee: start","job_status":"start","queue_duration_s":1.76595,"scheduling_latency_s":1.765976} gitlab # [ 146.797632] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d546b32043082a706886fee","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d546b32043082a706886fee: done: 0.023689 sec","job_status":"done","queue_duration_s":1.76595,"scheduling_latency_s":1.765976,"redis_calls":13,"redis_duration_s":0.007522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005609,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023689,"completed_at":"2026-08-15T23:43:32.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.833868] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f345484ee6023f3ee60af004","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f345484ee6023f3ee60af004: start","job_status":"start","queue_duration_s":1.792447,"scheduling_latency_s":1.792462} gitlab # [ 146.834667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f345484ee6023f3ee60af004","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f345484ee6023f3ee60af004: done: 0.010454 sec","job_status":"done","queue_duration_s":1.792447,"scheduling_latency_s":1.792462,"redis_calls":13,"redis_duration_s":0.002188,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001397,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010454,"completed_at":"2026-08-15T23:43:32.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.864283] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"194469e64b785c7b2af4b52e","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-194469e64b785c7b2af4b52e: start","job_status":"start","queue_duration_s":1.803862,"scheduling_latency_s":1.803875} gitlab # [ 146.899631] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"194469e64b785c7b2af4b52e","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-194469e64b785c7b2af4b52e: done: 0.010487 sec","job_status":"done","queue_duration_s":1.803862,"scheduling_latency_s":1.803875,"redis_calls":13,"redis_duration_s":0.002381,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010487,"completed_at":"2026-08-15T23:43:32.114Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.905055] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e867cec187b6ac11cff116a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e867cec187b6ac11cff116a: start","job_status":"start","queue_duration_s":1.815444,"scheduling_latency_s":1.815457} gitlab # [ 146.944700] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e867cec187b6ac11cff116a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e867cec187b6ac11cff116a: done: 0.009946 sec","job_status":"done","queue_duration_s":1.815444,"scheduling_latency_s":1.815457,"redis_calls":13,"redis_duration_s":0.002214,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001435,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009946,"completed_at":"2026-08-15T23:43:32.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.945837] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498cc4120b11c483c337b4fc","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498cc4120b11c483c337b4fc: start","job_status":"start","queue_duration_s":1.83075,"scheduling_latency_s":1.830764} gitlab # [ 146.987251] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498cc4120b11c483c337b4fc","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498cc4120b11c483c337b4fc: done: 0.018253 sec","job_status":"done","queue_duration_s":1.83075,"scheduling_latency_s":1.830764,"redis_calls":13,"redis_duration_s":0.008895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006677,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018253,"completed_at":"2026-08-15T23:43:32.149Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.988118] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31868a25717e17c23731d122","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31868a25717e17c23731d122: start","job_status":"start","queue_duration_s":1.851716,"scheduling_latency_s":1.851731} gitlab # [ 147.024291] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31868a25717e17c23731d122","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31868a25717e17c23731d122: done: 0.011719 sec","job_status":"done","queue_duration_s":1.851716,"scheduling_latency_s":1.851731,"redis_calls":13,"redis_duration_s":0.002741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011719,"completed_at":"2026-08-15T23:43:32.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.027190] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47537b18e202ad30560d9e85","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47537b18e202ad30560d9e85: start","job_status":"start","queue_duration_s":1.864389,"scheduling_latency_s":1.864403} gitlab # [ 147.068916] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47537b18e202ad30560d9e85","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47537b18e202ad30560d9e85: done: 0.009452 sec","job_status":"done","queue_duration_s":1.864389,"scheduling_latency_s":1.864403,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009452,"completed_at":"2026-08-15T23:43:32.174Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.069837] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b26105f3b19ea5acf52c398","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b26105f3b19ea5acf52c398: start","job_status":"start","queue_duration_s":1.874776,"scheduling_latency_s":1.87479} gitlab # [ 147.081712] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b26105f3b19ea5acf52c398","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b26105f3b19ea5acf52c398: done: 0.009316 sec","job_status":"done","queue_duration_s":1.874776,"scheduling_latency_s":1.87479,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009316,"completed_at":"2026-08-15T23:43:32.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.125953] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99fc62af3cfc050c85138f8a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99fc62af3cfc050c85138f8a: start","job_status":"start","queue_duration_s":1.885035,"scheduling_latency_s":1.885049} gitlab # [ 147.126586] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99fc62af3cfc050c85138f8a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99fc62af3cfc050c85138f8a: done: 0.013684 sec","job_status":"done","queue_duration_s":1.885035,"scheduling_latency_s":1.885049,"redis_calls":13,"redis_duration_s":0.005644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013684,"completed_at":"2026-08-15T23:43:32.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.150238] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47eb00606dcc5be91e8b7945","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47eb00606dcc5be91e8b7945: start","job_status":"start","queue_duration_s":1.901681,"scheduling_latency_s":1.901694} gitlab # [ 147.160481] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47eb00606dcc5be91e8b7945","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47eb00606dcc5be91e8b7945: done: 0.0099 sec","job_status":"done","queue_duration_s":1.901681,"scheduling_latency_s":1.901694,"redis_calls":13,"redis_duration_s":0.001821,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0099,"completed_at":"2026-08-15T23:43:32.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.213370] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"263388a8f3a59690b791d7ce","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-263388a8f3a59690b791d7ce: start","job_status":"start","queue_duration_s":1.912367,"scheduling_latency_s":1.91238} gitlab # [ 147.213971] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"263388a8f3a59690b791d7ce","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-263388a8f3a59690b791d7ce: done: 0.009456 sec","job_status":"done","queue_duration_s":1.912367,"scheduling_latency_s":1.91238,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009456,"completed_at":"2026-08-15T23:43:32.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.232245] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e083009b2bb258314a09a5a5","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e083009b2bb258314a09a5a5: start","job_status":"start","queue_duration_s":1.92262,"scheduling_latency_s":1.922633} gitlab # [ 147.242240] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e083009b2bb258314a09a5a5","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e083009b2bb258314a09a5a5: done: 0.009658 sec","job_status":"done","queue_duration_s":1.92262,"scheduling_latency_s":1.922633,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009658,"completed_at":"2026-08-15T23:43:32.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.285946] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f712beaebfe854fe394af97","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f712beaebfe854fe394af97: start","job_status":"start","queue_duration_s":1.933132,"scheduling_latency_s":1.933146} gitlab # [ 147.286633] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f712beaebfe854fe394af97","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f712beaebfe854fe394af97: done: 0.016678 sec","job_status":"done","queue_duration_s":1.933132,"scheduling_latency_s":1.933146,"redis_calls":13,"redis_duration_s":0.008230999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016678,"completed_at":"2026-08-15T23:43:32.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.314643] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8840d0d20ae1f741f909ac8","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8840d0d20ae1f741f909ac8: start","job_status":"start","queue_duration_s":1.950651,"scheduling_latency_s":1.950665} gitlab # [ 147.351239] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8840d0d20ae1f741f909ac8","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8840d0d20ae1f741f909ac8: done: 0.009389 sec","job_status":"done","queue_duration_s":1.950651,"scheduling_latency_s":1.950665,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009389,"completed_at":"2026-08-15T23:43:32.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.354847] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe44513155dcfe84495bde5c","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe44513155dcfe84495bde5c: start","job_status":"start","queue_duration_s":1.960858,"scheduling_latency_s":1.960872} gitlab # [ 147.364862] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe44513155dcfe84495bde5c","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe44513155dcfe84495bde5c: done: 0.009263 sec","job_status":"done","queue_duration_s":1.960858,"scheduling_latency_s":1.960872,"redis_calls":13,"redis_duration_s":0.0014460000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009263,"completed_at":"2026-08-15T23:43:32.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.396605] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc98fc98c99fdf5394e10054","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc98fc98c99fdf5394e10054: start","job_status":"start","queue_duration_s":1.971058,"scheduling_latency_s":1.971071} gitlab # [ 147.438286] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc98fc98c99fdf5394e10054","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc98fc98c99fdf5394e10054: done: 0.012963 sec","job_status":"done","queue_duration_s":1.971058,"scheduling_latency_s":1.971071,"redis_calls":13,"redis_duration_s":0.004985,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00398,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012963,"completed_at":"2026-08-15T23:43:32.284Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.439217] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"759837128d2124289c738f0a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-759837128d2124289c738f0a: start","job_status":"start","queue_duration_s":1.985139,"scheduling_latency_s":1.985152} gitlab # [ 147.447146] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"759837128d2124289c738f0a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-759837128d2124289c738f0a: done: 0.009545 sec","job_status":"done","queue_duration_s":1.985139,"scheduling_latency_s":1.985152,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009545,"completed_at":"2026-08-15T23:43:32.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.498628] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"345385c68cbaa3539103d9ed","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-345385c68cbaa3539103d9ed: start","job_status":"start","queue_duration_s":1.995632,"scheduling_latency_s":1.995645} gitlab # [ 147.499467] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"345385c68cbaa3539103d9ed","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-345385c68cbaa3539103d9ed: done: 0.009326 sec","job_status":"done","queue_duration_s":1.995632,"scheduling_latency_s":1.995645,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009326,"completed_at":"2026-08-15T23:43:32.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.534986] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c05ce9432dd1a8fb518fb28","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c05ce9432dd1a8fb518fb28: start","job_status":"start","queue_duration_s":2.005919,"scheduling_latency_s":2.005934} gitlab # [ 147.535539] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c05ce9432dd1a8fb518fb28","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c05ce9432dd1a8fb518fb28: done: 0.009209 sec","job_status":"done","queue_duration_s":2.005919,"scheduling_latency_s":2.005934,"redis_calls":13,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009209,"completed_at":"2026-08-15T23:43:32.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.573183] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e59b2fb7112a64d6e2ce7ec","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e59b2fb7112a64d6e2ce7ec: start","job_status":"start","queue_duration_s":2.016115,"scheduling_latency_s":2.016128} gitlab # [ 147.573817] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e59b2fb7112a64d6e2ce7ec","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e59b2fb7112a64d6e2ce7ec: done: 0.015086 sec","job_status":"done","queue_duration_s":2.016115,"scheduling_latency_s":2.016128,"redis_calls":13,"redis_duration_s":0.004619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015086,"completed_at":"2026-08-15T23:43:32.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.613135] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bdb180aa30885e97e6f059d","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bdb180aa30885e97e6f059d: start","job_status":"start","queue_duration_s":2.032074,"scheduling_latency_s":2.032088} gitlab # [ 147.613781] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bdb180aa30885e97e6f059d","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bdb180aa30885e97e6f059d: done: 0.009403 sec","job_status":"done","queue_duration_s":2.032074,"scheduling_latency_s":2.032088,"redis_calls":13,"redis_duration_s":0.001442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009403,"completed_at":"2026-08-15T23:43:32.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.657471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99c2ce6a5f3520838b46984a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99c2ce6a5f3520838b46984a: start","job_status":"start","queue_duration_s":2.042274,"scheduling_latency_s":2.042287} gitlab # [ 147.658098] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99c2ce6a5f3520838b46984a","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99c2ce6a5f3520838b46984a: done: 0.009386 sec","job_status":"done","queue_duration_s":2.042274,"scheduling_latency_s":2.042287,"redis_calls":13,"redis_duration_s":0.001593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009386,"completed_at":"2026-08-15T23:43:32.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.700057] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86b983bb56cc2a953ae6a50c","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86b983bb56cc2a953ae6a50c: start","job_status":"start","queue_duration_s":2.05246,"scheduling_latency_s":2.052474} gitlab # [ 147.700723] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86b983bb56cc2a953ae6a50c","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86b983bb56cc2a953ae6a50c: done: 0.020886 sec","job_status":"done","queue_duration_s":2.05246,"scheduling_latency_s":2.052474,"redis_calls":13,"redis_duration_s":0.008957000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020886,"completed_at":"2026-08-15T23:43:32.373Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.746840] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8eb0a04be32429bbe0be82","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8eb0a04be32429bbe0be82: start","job_status":"start","queue_duration_s":2.074468,"scheduling_latency_s":2.074531} gitlab # [ 147.747433] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8eb0a04be32429bbe0be82","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8eb0a04be32429bbe0be82: done: 0.013413 sec","job_status":"done","queue_duration_s":2.074468,"scheduling_latency_s":2.074531,"redis_calls":13,"redis_duration_s":0.001722,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013413,"completed_at":"2026-08-15T23:43:32.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.783871] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aff23a6e5b3e5e65118e7a4","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aff23a6e5b3e5e65118e7a4: start","job_status":"start","queue_duration_s":2.088995,"scheduling_latency_s":2.08901} gitlab # [ 147.784464] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aff23a6e5b3e5e65118e7a4","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aff23a6e5b3e5e65118e7a4: done: 0.010289 sec","job_status":"done","queue_duration_s":2.088995,"scheduling_latency_s":2.08901,"redis_calls":13,"redis_duration_s":0.001879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010289,"completed_at":"2026-08-15T23:43:32.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 147.800484] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc03a9b19d8b79fa404cb65e","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc03a9b19d8b79fa404cb65e: start","job_status":"start","queue_duration_s":2.100215,"scheduling_latency_s":2.100227} gitlab # [ 147.835820] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:43:32.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc03a9b19d8b79fa404cb65e","created_at":"2026-08-15T23:43:30.208Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-0ea9bc388626469c","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a0c4d9a6f89c208c724cb22bf6c46903","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:43:30.300Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc03a9b19d8b79fa404cb65e: done: 0.009841 sec","job_status":"done","queue_duration_s":2.100215,"scheduling_latency_s":2.100227,"redis_calls":13,"redis_duration_s":0.0016779999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009841,"completed_at":"2026-08-15T23:43:32.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 148.020349] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1596092586 wd_nsec: 1596092639 gitlab # [ 160.871507] setup-gitlab-start[2219]: W, [2026-08-15T23:43:46.163685 #2219] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 178.960358] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fa0a7f9a28e198488feb4fff","created_at":"2026-08-15T23:44:04.201Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fece1798429f99e985c22cce6773cde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.249Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fa0a7f9a28e198488feb4fff: start","job_status":"start","queue_duration_s":0.002926,"scheduling_latency_s":0.002976} gitlab # [ 179.465870] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fa0a7f9a28e198488feb4fff","created_at":"2026-08-15T23:44:04.201Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fece1798429f99e985c22cce6773cde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.249Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fa0a7f9a28e198488feb4fff: done: 0.506565 sec","job_status":"done","queue_duration_s":0.002926,"scheduling_latency_s":0.002976,"redis_calls":11,"redis_duration_s":0.01646,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001564,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012239,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.125,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.125,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002753702,"exclusive_lock_hold_duration_s":0.408337373,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.506565,"completed_at":"2026-08-15T23:44:04.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.270783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.503267] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2c90b93bf7c58ca0c7c9c823","created_at":"2026-08-15T23:44:04.259Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0da68af75ec7b91e2f984299e28fb47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.261Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2c90b93bf7c58ca0c7c9c823: start","job_status":"start","queue_duration_s":0.534009,"scheduling_latency_s":0.534042} gitlab # [ 179.533831] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2c90b93bf7c58ca0c7c9c823","created_at":"2026-08-15T23:44:04.259Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0da68af75ec7b91e2f984299e28fb47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.261Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2c90b93bf7c58ca0c7c9c823: done: 0.030497 sec","job_status":"done","queue_duration_s":0.534009,"scheduling_latency_s":0.534042,"redis_calls":9,"redis_duration_s":0.0018369999999999999,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061628,"exclusive_lock_hold_duration_s":0.004299708,"duration_s":0.030497,"completed_at":"2026-08-15T23:44:04.826Z","load_balancing_strategy":"primary","db_duration_s":0.001543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.568257] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"a8c427469f9abc8c74f360f5","created_at":"2026-08-15T23:44:04.285Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.294Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-a8c427469f9abc8c74f360f5: start","job_status":"start","queue_duration_s":0.566181,"scheduling_latency_s":0.566227} gitlab # [ 179.629175] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"a8c427469f9abc8c74f360f5","created_at":"2026-08-15T23:44:04.285Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.294Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-a8c427469f9abc8c74f360f5: done: 0.061235 sec","job_status":"done","queue_duration_s":0.566181,"scheduling_latency_s":0.566227,"redis_calls":28,"redis_duration_s":0.007484,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001299,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000383,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.00408,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000301435,"duration_s":0.061235,"completed_at":"2026-08-15T23:44:04.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.678976] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:04.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"79a815c2754f47013be476b1","created_at":"2026-08-15T23:44:04.313Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4246807690e7e60fc358084969c802e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.316Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-79a815c2754f47013be476b1: start","job_status":"start","queue_duration_s":0.654833,"scheduling_latency_s":0.654881} gitlab # [ 179.749267] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"79a815c2754f47013be476b1","created_at":"2026-08-15T23:44:04.313Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4246807690e7e60fc358084969c802e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.316Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-79a815c2754f47013be476b1: done: 0.069782 sec","job_status":"done","queue_duration_s":0.654833,"scheduling_latency_s":0.654881,"redis_calls":9,"redis_duration_s":0.003203,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000828317,"exclusive_lock_hold_duration_s":0.044093593,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.069782,"completed_at":"2026-08-15T23:44:05.041Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.813400] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b2edf997a5edc8b42b0a2b84","created_at":"2026-08-15T23:44:04.327Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f3c909b981dbac7e9565df33ed10f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:44:04.330Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b2edf997a5edc8b42b0a2b84: start","job_status":"start","queue_duration_s":0.775335,"scheduling_latency_s":0.775386} gitlab # [ 179.830692] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.123Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 179.839754] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b2edf997a5edc8b42b0a2b84","created_at":"2026-08-15T23:44:04.327Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f3c909b981dbac7e9565df33ed10f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:44:04.330Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b2edf997a5edc8b42b0a2b84: done: 0.026484 sec","job_status":"done","queue_duration_s":0.775335,"scheduling_latency_s":0.775386,"redis_calls":7,"redis_duration_s":0.003096,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000783,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026484,"completed_at":"2026-08-15T23:44:05.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.842810] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"355fb79c319a4b3697623b76","created_at":"2026-08-15T23:44:04.338Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9382772f5c39770dc272fbdae3cf1011","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.343Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-355fb79c319a4b3697623b76: start","job_status":"start","queue_duration_s":0.791869,"scheduling_latency_s":0.791905} gitlab # [ 179.864738] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"355fb79c319a4b3697623b76","created_at":"2026-08-15T23:44:04.338Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9382772f5c39770dc272fbdae3cf1011","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.343Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-355fb79c319a4b3697623b76: done: 0.02189 sec","job_status":"done","queue_duration_s":0.791869,"scheduling_latency_s":0.791905,"redis_calls":9,"redis_duration_s":0.002634,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063779,"exclusive_lock_hold_duration_s":0.003767518,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.02189,"completed_at":"2026-08-15T23:44:05.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.882765] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.163Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e300958814244325b45ce1df","created_at":"2026-08-15T23:44:04.350Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"632d915e2f2c47fb3fa1bed1f63e9cce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:44:04.352Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e300958814244325b45ce1df: start","job_status":"start","queue_duration_s":0.810993,"scheduling_latency_s":0.811018} gitlab # [ 179.893687] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.181Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 179.896339] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e300958814244325b45ce1df","created_at":"2026-08-15T23:44:04.350Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"632d915e2f2c47fb3fa1bed1f63e9cce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:44:04.352Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e300958814244325b45ce1df: done: 0.025189 sec","job_status":"done","queue_duration_s":0.810993,"scheduling_latency_s":0.811018,"redis_calls":7,"redis_duration_s":0.014079,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025189,"completed_at":"2026-08-15T23:44:05.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.934669] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0f08815ad1adc966290c2cf7","created_at":"2026-08-15T23:44:04.363Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c379d94943e3bb3393bb6b4a48071b2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.366Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0f08815ad1adc966290c2cf7: start","job_status":"start","queue_duration_s":0.827809,"scheduling_latency_s":0.827826} gitlab # [ 179.938230] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.208Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0f08815ad1adc966290c2cf7","created_at":"2026-08-15T23:44:04.363Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c379d94943e3bb3393bb6b4a48071b2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.366Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0f08815ad1adc966290c2cf7: done: 0.014548 sec","job_status":"done","queue_duration_s":0.827809,"scheduling_latency_s":0.827826,"redis_calls":7,"redis_duration_s":0.000967,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.014548,"completed_at":"2026-08-15T23:44:05.208Z","load_balancing_strategy":"primary","db_duration_s":0.004805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 179.993970] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d67445fbffc819d1fa2b849a","created_at":"2026-08-15T23:44:04.370Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10eb8a3ec7a9f8564263a81ab5607fdc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.371Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d67445fbffc819d1fa2b849a: start","job_status":"start","queue_duration_s":0.837822,"scheduling_latency_s":0.837835} gitlab # [ 179.994687] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.222Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d67445fbffc819d1fa2b849a","created_at":"2026-08-15T23:44:04.370Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10eb8a3ec7a9f8564263a81ab5607fdc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.371Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d67445fbffc819d1fa2b849a: done: 0.012487 sec","job_status":"done","queue_duration_s":0.837822,"scheduling_latency_s":0.837835,"redis_calls":7,"redis_duration_s":0.0009379999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012487,"completed_at":"2026-08-15T23:44:05.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.044139] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c97aa4dddbd94895217391d1","created_at":"2026-08-15T23:44:04.378Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"939a83f5474420cf7dce8185cbd22348","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.382Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c97aa4dddbd94895217391d1: start","job_status":"start","queue_duration_s":0.840843,"scheduling_latency_s":0.840857} gitlab # [ 180.044906] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c97aa4dddbd94895217391d1","created_at":"2026-08-15T23:44:04.378Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"939a83f5474420cf7dce8185cbd22348","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.382Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c97aa4dddbd94895217391d1: done: 0.029773 sec","job_status":"done","queue_duration_s":0.840843,"scheduling_latency_s":0.840857,"redis_calls":9,"redis_duration_s":0.006994,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005399,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000586667,"exclusive_lock_hold_duration_s":0.011514592,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.029773,"completed_at":"2026-08-15T23:44:05.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.083718] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d1f990033fb12e44e51d6601","created_at":"2026-08-15T23:44:04.399Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.402Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d1f990033fb12e44e51d6601: start","job_status":"start","queue_duration_s":0.850895,"scheduling_latency_s":0.850908} gitlab # [ 180.084577] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d1f990033fb12e44e51d6601","created_at":"2026-08-15T23:44:04.399Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.402Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d1f990033fb12e44e51d6601: done: 0.015718 sec","job_status":"done","queue_duration_s":0.850895,"scheduling_latency_s":0.850908,"redis_calls":14,"redis_duration_s":0.001856,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000207,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015718,"completed_at":"2026-08-15T23:44:05.269Z","load_balancing_strategy":"primary","db_duration_s":0.000684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.133754] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b52a6dfdb1741e8cd0223b11","created_at":"2026-08-15T23:44:04.427Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e679a51711de60d5643b3d871d357ba","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.430Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b52a6dfdb1741e8cd0223b11: start","job_status":"start","queue_duration_s":0.839673,"scheduling_latency_s":0.839687} gitlab # [ 180.134599] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b52a6dfdb1741e8cd0223b11","created_at":"2026-08-15T23:44:04.427Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e679a51711de60d5643b3d871d357ba","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.430Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b52a6dfdb1741e8cd0223b11: done: 0.008863 sec","job_status":"done","queue_duration_s":0.839673,"scheduling_latency_s":0.839687,"redis_calls":7,"redis_duration_s":0.0009010000000000001,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008863,"completed_at":"2026-08-15T23:44:05.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.171488] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"644899172f362510e220e8c7","created_at":"2026-08-15T23:44:04.448Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ef51db605e63430ce8a4c980cf5cc62","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.451Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-644899172f362510e220e8c7: start","job_status":"start","queue_duration_s":0.828779,"scheduling_latency_s":0.828792} gitlab # [ 180.172235] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.284Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 180.172700] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"644899172f362510e220e8c7","created_at":"2026-08-15T23:44:04.448Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ef51db605e63430ce8a4c980cf5cc62","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.451Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-644899172f362510e220e8c7: done: 0.010758 sec","job_status":"done","queue_duration_s":0.828779,"scheduling_latency_s":0.828792,"redis_calls":7,"redis_duration_s":0.003835,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010758,"completed_at":"2026-08-15T23:44:05.290Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.220215] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9cf8a3a376c349338e5be8c6","created_at":"2026-08-15T23:44:04.463Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6276701ea3cb94789ced23171cb430b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.467Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9cf8a3a376c349338e5be8c6: start","job_status":"start","queue_duration_s":0.826183,"scheduling_latency_s":0.826197} gitlab # [ 180.220898] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9cf8a3a376c349338e5be8c6","created_at":"2026-08-15T23:44:04.463Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6276701ea3cb94789ced23171cb430b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.467Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9cf8a3a376c349338e5be8c6: done: 0.010647 sec","job_status":"done","queue_duration_s":0.826183,"scheduling_latency_s":0.826197,"redis_calls":7,"redis_duration_s":0.002735,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010647,"completed_at":"2026-08-15T23:44:05.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.256491] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.305Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bc0029f5f5e9204ce7fc9e9","created_at":"2026-08-15T23:44:04.482Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"654cf8308668a5b44cdf45b15984b898","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.492Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bc0029f5f5e9204ce7fc9e9: start","job_status":"start","queue_duration_s":0.812803,"scheduling_latency_s":0.812817} gitlab # [ 180.257178] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bc0029f5f5e9204ce7fc9e9","created_at":"2026-08-15T23:44:04.482Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"654cf8308668a5b44cdf45b15984b898","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.492Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bc0029f5f5e9204ce7fc9e9: done: 0.01258 sec","job_status":"done","queue_duration_s":0.812803,"scheduling_latency_s":0.812817,"redis_calls":12,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000304,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199467,"duration_s":0.01258,"completed_at":"2026-08-15T23:44:05.317Z","load_balancing_strategy":"primary","db_duration_s":0.000455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.316191] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f444bbf122b605350699fc79","created_at":"2026-08-15T23:44:04.515Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5b5f7ae674d28cbe8f23074e2f3eae8","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.517Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f444bbf122b605350699fc79: start","job_status":"start","queue_duration_s":0.800924,"scheduling_latency_s":0.800937} gitlab # [ 180.316855] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f444bbf122b605350699fc79","created_at":"2026-08-15T23:44:04.515Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5b5f7ae674d28cbe8f23074e2f3eae8","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.517Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f444bbf122b605350699fc79: done: 0.257155 sec","job_status":"done","queue_duration_s":0.800924,"scheduling_latency_s":0.800937,"redis_calls":562,"redis_duration_s":0.104502,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.103616,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.257155,"completed_at":"2026-08-15T23:44:05.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.332336] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"14ca2a98fec442665705e36a","created_at":"2026-08-15T23:44:04.527Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ee14146bbf72c40adbfcb3ffaf3beb4","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.569Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-14ca2a98fec442665705e36a: start","job_status":"start","queue_duration_s":1.007585,"scheduling_latency_s":1.007736} gitlab # [ 180.373752] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"14ca2a98fec442665705e36a","created_at":"2026-08-15T23:44:04.527Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ee14146bbf72c40adbfcb3ffaf3beb4","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.569Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-14ca2a98fec442665705e36a: done: 0.013336 sec","job_status":"done","queue_duration_s":1.007585,"scheduling_latency_s":1.007736,"redis_calls":10,"redis_duration_s":0.001341,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003698235,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.013336,"completed_at":"2026-08-15T23:44:05.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001641,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 180.378312] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"752a4c30e20fa97bab192137","created_at":"2026-08-15T23:44:04.584Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c7d11d56039fa0f30c144902a24d503","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.587Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-752a4c30e20fa97bab192137: start","job_status":"start","queue_duration_s":1.003801,"scheduling_latency_s":1.003813} gitlab # [ 180.390466] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.595Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 180.393652] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"752a4c30e20fa97bab192137","created_at":"2026-08-15T23:44:04.584Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c7d11d56039fa0f30c144902a24d503","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.587Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-752a4c30e20fa97bab192137: done: 0.007547 sec","job_status":"done","queue_duration_s":1.003801,"scheduling_latency_s":1.003813,"redis_calls":7,"redis_duration_s":0.000842,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007547,"completed_at":"2026-08-15T23:44:05.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.435642] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2334e1d3f8842e71fa792d31","created_at":"2026-08-15T23:44:04.603Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c33d5ae0600e31658e47acbb59156f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.606Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2334e1d3f8842e71fa792d31: start","job_status":"start","queue_duration_s":0.992885,"scheduling_latency_s":0.992899} gitlab # [ 180.437535] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2334e1d3f8842e71fa792d31","created_at":"2026-08-15T23:44:04.603Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c33d5ae0600e31658e47acbb59156f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.606Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2334e1d3f8842e71fa792d31: done: 0.007778 sec","job_status":"done","queue_duration_s":0.992885,"scheduling_latency_s":0.992899,"redis_calls":7,"redis_duration_s":0.001069,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007778,"completed_at":"2026-08-15T23:44:05.607Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.482107] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"4d02a5d98960227fcbe398f0","created_at":"2026-08-15T23:44:04.618Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"0bd57d35464a137b1e57a817342e0506","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.628Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-4d02a5d98960227fcbe398f0: start","job_status":"start","queue_duration_s":0.979894,"scheduling_latency_s":0.979908} gitlab # [ 180.482752] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.630Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"4d02a5d98960227fcbe398f0","created_at":"2026-08-15T23:44:04.618Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"0bd57d35464a137b1e57a817342e0506","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.628Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-4d02a5d98960227fcbe398f0: done: 0.022924 sec","job_status":"done","queue_duration_s":0.979894,"scheduling_latency_s":0.979908,"redis_calls":10,"redis_duration_s":0.007147,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000895924,"duration_s":0.022924,"completed_at":"2026-08-15T23:44:05.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.518605] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f74a520c2a8b25d36a1cde58","created_at":"2026-08-15T23:44:04.652Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2feb426bd90c6783354f242bdc466868","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.655Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f74a520c2a8b25d36a1cde58: start","job_status":"start","queue_duration_s":0.977227,"scheduling_latency_s":0.97724} gitlab # [ 180.524848] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.637Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 180.527659] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f74a520c2a8b25d36a1cde58","created_at":"2026-08-15T23:44:04.652Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2feb426bd90c6783354f242bdc466868","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.655Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f74a520c2a8b25d36a1cde58: done: 0.007652 sec","job_status":"done","queue_duration_s":0.977227,"scheduling_latency_s":0.97724,"redis_calls":7,"redis_duration_s":0.000912,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007652,"completed_at":"2026-08-15T23:44:05.640Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.574231] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"aacc8735c24e07bdfef03937","created_at":"2026-08-15T23:44:04.670Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40ca74646aa6501ec880675e45b70de1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.681Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-aacc8735c24e07bdfef03937: start","job_status":"start","queue_duration_s":0.960168,"scheduling_latency_s":0.960181} gitlab # [ 180.574934] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"aacc8735c24e07bdfef03937","created_at":"2026-08-15T23:44:04.670Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40ca74646aa6501ec880675e45b70de1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.681Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-aacc8735c24e07bdfef03937: done: 0.015874 sec","job_status":"done","queue_duration_s":0.960168,"scheduling_latency_s":0.960181,"redis_calls":10,"redis_duration_s":0.0012460000000000001,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201422,"duration_s":0.015874,"completed_at":"2026-08-15T23:44:05.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.605692] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f0321c23b3bfcd6b2190c835","created_at":"2026-08-15T23:44:04.691Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.693Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f0321c23b3bfcd6b2190c835: start","job_status":"start","queue_duration_s":0.963995,"scheduling_latency_s":0.964007} gitlab # [ 180.616794] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f0321c23b3bfcd6b2190c835","created_at":"2026-08-15T23:44:04.691Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.693Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f0321c23b3bfcd6b2190c835: done: 0.060833 sec","job_status":"done","queue_duration_s":0.963995,"scheduling_latency_s":0.964007,"redis_calls":60,"redis_duration_s":0.015945,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000421,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.015175,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060833,"completed_at":"2026-08-15T23:44:05.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.665070] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c3270676508d64e685db3fd1","created_at":"2026-08-15T23:44:04.702Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b805e50929a4ee468a634639802d562","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.710Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c3270676508d64e685db3fd1: start","job_status":"start","queue_duration_s":1.009058,"scheduling_latency_s":1.009075} gitlab # [ 180.665703] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"c3270676508d64e685db3fd1","created_at":"2026-08-15T23:44:04.702Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b805e50929a4ee468a634639802d562","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.710Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-c3270676508d64e685db3fd1: done: 0.022182 sec","job_status":"done","queue_duration_s":1.009058,"scheduling_latency_s":1.009075,"redis_calls":12,"redis_duration_s":0.008061,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002807,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003353,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001240381,"exclusive_lock_hold_duration_s":0.004370946,"duration_s":0.022182,"completed_at":"2026-08-15T23:44:05.742Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.707665] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0e71d4ad518f8eb32d8eb3b1","created_at":"2026-08-15T23:44:04.722Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"419406163d1336a63519501ba9f102d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.724Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0e71d4ad518f8eb32d8eb3b1: start","job_status":"start","queue_duration_s":1.018333,"scheduling_latency_s":1.018346} gitlab # [ 180.708287] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.747Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 180.708857] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0e71d4ad518f8eb32d8eb3b1","created_at":"2026-08-15T23:44:04.722Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"419406163d1336a63519501ba9f102d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.724Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0e71d4ad518f8eb32d8eb3b1: done: 0.007515 sec","job_status":"done","queue_duration_s":1.018333,"scheduling_latency_s":1.018346,"redis_calls":7,"redis_duration_s":0.000877,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007515,"completed_at":"2026-08-15T23:44:05.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.754637] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c7d06e688a2d4b1988f87fbd","created_at":"2026-08-15T23:44:04.733Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5e44de5cf6b089777b8eb44bdb15b9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:44:04.735Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c7d06e688a2d4b1988f87fbd: start","job_status":"start","queue_duration_s":1.015915,"scheduling_latency_s":1.015928} gitlab # [ 180.755409] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c7d06e688a2d4b1988f87fbd","created_at":"2026-08-15T23:44:04.733Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-146ee10657e54959","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5e44de5cf6b089777b8eb44bdb15b9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:44:04.735Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c7d06e688a2d4b1988f87fbd: done: 0.0125 sec","job_status":"done","queue_duration_s":1.015915,"scheduling_latency_s":1.015928,"redis_calls":7,"redis_duration_s":0.000877,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0125,"completed_at":"2026-08-15T23:44:05.763Z","load_balancing_strategy":"primary","db_duration_s":0.000971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.804246] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bcad982c807bf01fd242293d","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bcad982c807bf01fd242293d: start","job_status":"start","queue_duration_s":0.849246,"scheduling_latency_s":0.849259} gitlab # [ 180.805064] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bcad982c807bf01fd242293d","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bcad982c807bf01fd242293d: done: 0.02519 sec","job_status":"done","queue_duration_s":0.849246,"scheduling_latency_s":0.849259,"redis_calls":16,"redis_duration_s":0.0019630000000000003,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198349,"duration_s":0.02519,"completed_at":"2026-08-15T23:44:05.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.854427] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fa50c00a816375e3309fb970","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fa50c00a816375e3309fb970: start","job_status":"start","queue_duration_s":0.875333,"scheduling_latency_s":0.875346} gitlab # [ 180.855096] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fa50c00a816375e3309fb970","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fa50c00a816375e3309fb970: done: 0.00967 sec","job_status":"done","queue_duration_s":0.875333,"scheduling_latency_s":0.875346,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00967,"completed_at":"2026-08-15T23:44:05.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.892602] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c875cd608f0ab855adb5e48c","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c875cd608f0ab855adb5e48c: start","job_status":"start","queue_duration_s":0.885822,"scheduling_latency_s":0.885836} gitlab # [ 180.893481] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c875cd608f0ab855adb5e48c","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c875cd608f0ab855adb5e48c: done: 0.009379 sec","job_status":"done","queue_duration_s":0.885822,"scheduling_latency_s":0.885836,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009379,"completed_at":"2026-08-15T23:44:05.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.940772] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dc5907ff9f8adc76e05e14ed","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dc5907ff9f8adc76e05e14ed: start","job_status":"start","queue_duration_s":0.901041,"scheduling_latency_s":0.901056} gitlab # [ 180.941525] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dc5907ff9f8adc76e05e14ed","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dc5907ff9f8adc76e05e14ed: done: 0.019762 sec","job_status":"done","queue_duration_s":0.901041,"scheduling_latency_s":0.901056,"redis_calls":13,"redis_duration_s":0.008164,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006605,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019762,"completed_at":"2026-08-15T23:44:05.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 180.979723] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"36977f69f12307e6b9b7281d","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-36977f69f12307e6b9b7281d: start","job_status":"start","queue_duration_s":0.921628,"scheduling_latency_s":0.921642} gitlab # [ 180.980562] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"36977f69f12307e6b9b7281d","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-36977f69f12307e6b9b7281d: done: 0.009703 sec","job_status":"done","queue_duration_s":0.921628,"scheduling_latency_s":0.921642,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009703,"completed_at":"2026-08-15T23:44:05.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.022955] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2e87903fa2bbe8e60e4ee5d3","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2e87903fa2bbe8e60e4ee5d3: start","job_status":"start","queue_duration_s":0.93225,"scheduling_latency_s":0.932263} gitlab # [ 181.023725] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2e87903fa2bbe8e60e4ee5d3","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2e87903fa2bbe8e60e4ee5d3: done: 0.009572 sec","job_status":"done","queue_duration_s":0.93225,"scheduling_latency_s":0.932263,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009572,"completed_at":"2026-08-15T23:44:05.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.036742] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7f41c5122c7b4c4287f307c","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7f41c5122c7b4c4287f307c: start","job_status":"start","queue_duration_s":0.942624,"scheduling_latency_s":0.942639} gitlab # [ 181.072826] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7f41c5122c7b4c4287f307c","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7f41c5122c7b4c4287f307c: done: 0.009341 sec","job_status":"done","queue_duration_s":0.942624,"scheduling_latency_s":0.942639,"redis_calls":13,"redis_duration_s":0.001665,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009341,"completed_at":"2026-08-15T23:44:05.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.111654] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f8a77ee633013ea52a201b8b","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f8a77ee633013ea52a201b8b: start","job_status":"start","queue_duration_s":0.956975,"scheduling_latency_s":0.956989} gitlab # [ 181.112316] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f8a77ee633013ea52a201b8b","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f8a77ee633013ea52a201b8b: done: 0.021349 sec","job_status":"done","queue_duration_s":0.956975,"scheduling_latency_s":0.956989,"redis_calls":13,"redis_duration_s":0.009814,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021349,"completed_at":"2026-08-15T23:44:05.893Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.153943] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9b47050990dda80730f581d7","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9b47050990dda80730f581d7: start","job_status":"start","queue_duration_s":0.981051,"scheduling_latency_s":0.981067} gitlab # [ 181.154683] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9b47050990dda80730f581d7","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9b47050990dda80730f581d7: done: 0.012416 sec","job_status":"done","queue_duration_s":0.981051,"scheduling_latency_s":0.981067,"redis_calls":13,"redis_duration_s":0.002968,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012416,"completed_at":"2026-08-15T23:44:05.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000787,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.189643] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"214563fabc54888f6b541842","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-214563fabc54888f6b541842: start","job_status":"start","queue_duration_s":0.994313,"scheduling_latency_s":0.994327} gitlab # [ 181.190231] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"214563fabc54888f6b541842","created_at":"2026-08-15T23:44:04.893Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-2fbfc2a6cdf44954","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"1a1f4d6be92901033464c5e015cc8f61","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:04.915Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-214563fabc54888f6b541842: done: 0.010047 sec","job_status":"done","queue_duration_s":0.994313,"scheduling_latency_s":0.994327,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010047,"completed_at":"2026-08-15T23:44:05.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.204607] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.920Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"68f611bf1f5afe2b9b42cc01","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-68f611bf1f5afe2b9b42cc01: start","job_status":"start","queue_duration_s":0.654613,"scheduling_latency_s":0.654627} gitlab # [ 181.214693] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.927Z","message":"No existing merge request to be cleaned up."} gitlab # [ 181.215979] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.932Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"68f611bf1f5afe2b9b42cc01","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-68f611bf1f5afe2b9b42cc01: done: 0.011524 sec","job_status":"done","queue_duration_s":0.654613,"scheduling_latency_s":0.654627,"redis_calls":10,"redis_duration_s":0.001444,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011524,"completed_at":"2026-08-15T23:44:05.932Z","load_balancing_strategy":"primary","db_duration_s":0.001193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.253982] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.932Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b7f9d7e33a30c007e8006d15","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b7f9d7e33a30c007e8006d15: start","job_status":"start","queue_duration_s":0.666965,"scheduling_latency_s":0.666978} gitlab # [ 181.256756] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.939Z","message":"No existing merge request to be cleaned up."} gitlab # [ 181.258074] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.943Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b7f9d7e33a30c007e8006d15","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b7f9d7e33a30c007e8006d15: done: 0.010855 sec","job_status":"done","queue_duration_s":0.666965,"scheduling_latency_s":0.666978,"redis_calls":10,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010855,"completed_at":"2026-08-15T23:44:05.943Z","load_balancing_strategy":"primary","db_duration_s":0.000925,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.302901] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.944Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"33b908dd5d9e7b470e113880","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-33b908dd5d9e7b470e113880: start","job_status":"start","queue_duration_s":0.678803,"scheduling_latency_s":0.678817} gitlab # [ 181.303528] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.950Z","message":"No existing merge request to be cleaned up."} gitlab # [ 181.303967] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.955Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"33b908dd5d9e7b470e113880","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-33b908dd5d9e7b470e113880: done: 0.010327 sec","job_status":"done","queue_duration_s":0.678803,"scheduling_latency_s":0.678817,"redis_calls":10,"redis_duration_s":0.0012309999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010327,"completed_at":"2026-08-15T23:44:05.955Z","load_balancing_strategy":"primary","db_duration_s":0.000924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.343658] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.955Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"082629f722a0ae21ffc6fc6a","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-082629f722a0ae21ffc6fc6a: start","job_status":"start","queue_duration_s":0.689972,"scheduling_latency_s":0.689985} gitlab # [ 181.344435] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.965Z","message":"No existing merge request to be cleaned up."} gitlab # [ 181.344881] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.969Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"082629f722a0ae21ffc6fc6a","created_at":"2026-08-15T23:44:05.260Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-86517cdf5c804b96","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"941cda1baa2d5f4d9533f4bd6d462b5f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.265Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-082629f722a0ae21ffc6fc6a: done: 0.013827 sec","job_status":"done","queue_duration_s":0.689972,"scheduling_latency_s":0.689985,"redis_calls":10,"redis_duration_s":0.0021780000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013827,"completed_at":"2026-08-15T23:44:05.969Z","load_balancing_strategy":"primary","db_duration_s":0.004236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.380746] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cc837f81592e1319d926cfb","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cc837f81592e1319d926cfb: start","job_status":"start","queue_duration_s":0.256405,"scheduling_latency_s":0.256419} gitlab # [ 181.382096] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cc837f81592e1319d926cfb","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cc837f81592e1319d926cfb: done: 0.009301 sec","job_status":"done","queue_duration_s":0.256405,"scheduling_latency_s":0.256419,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009301,"completed_at":"2026-08-15T23:44:05.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.427667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ef0960fa971b3d0445904ea","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ef0960fa971b3d0445904ea: start","job_status":"start","queue_duration_s":0.266519,"scheduling_latency_s":0.266533} gitlab # [ 181.428457] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ef0960fa971b3d0445904ea","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ef0960fa971b3d0445904ea: done: 0.008833 sec","job_status":"done","queue_duration_s":0.266519,"scheduling_latency_s":0.266533,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008833,"completed_at":"2026-08-15T23:44:05.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.470916] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25a4e85697f433bad64e1c64","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25a4e85697f433bad64e1c64: start","job_status":"start","queue_duration_s":0.27618,"scheduling_latency_s":0.276194} gitlab # [ 181.471615] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:05.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25a4e85697f433bad64e1c64","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25a4e85697f433bad64e1c64: done: 0.008799 sec","job_status":"done","queue_duration_s":0.27618,"scheduling_latency_s":0.276194,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008799,"completed_at":"2026-08-15T23:44:05.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.495783] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ea59cca75f43f9cb366c87e","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ea59cca75f43f9cb366c87e: start","job_status":"start","queue_duration_s":0.289188,"scheduling_latency_s":0.289201} gitlab # [ 181.505803] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ea59cca75f43f9cb366c87e","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ea59cca75f43f9cb366c87e: done: 0.010141 sec","job_status":"done","queue_duration_s":0.289188,"scheduling_latency_s":0.289201,"redis_calls":13,"redis_duration_s":0.001801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010141,"completed_at":"2026-08-15T23:44:06.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.552679] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e201a170cf664d1a1a44781","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e201a170cf664d1a1a44781: start","job_status":"start","queue_duration_s":0.300343,"scheduling_latency_s":0.300356} gitlab # [ 181.553588] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e201a170cf664d1a1a44781","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e201a170cf664d1a1a44781: done: 0.008927 sec","job_status":"done","queue_duration_s":0.300343,"scheduling_latency_s":0.300356,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008927,"completed_at":"2026-08-15T23:44:06.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.578594] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3de57adeb357f4874d377a61","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3de57adeb357f4874d377a61: start","job_status":"start","queue_duration_s":0.310094,"scheduling_latency_s":0.310107} gitlab # [ 181.588671] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3de57adeb357f4874d377a61","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3de57adeb357f4874d377a61: done: 0.008845 sec","job_status":"done","queue_duration_s":0.310094,"scheduling_latency_s":0.310107,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008845,"completed_at":"2026-08-15T23:44:06.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.625712] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0f28cb25b731d86981ff08","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0f28cb25b731d86981ff08: start","job_status":"start","queue_duration_s":0.319753,"scheduling_latency_s":0.319767} gitlab # [ 181.629262] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0f28cb25b731d86981ff08","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0f28cb25b731d86981ff08: done: 0.009002 sec","job_status":"done","queue_duration_s":0.319753,"scheduling_latency_s":0.319767,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009002,"completed_at":"2026-08-15T23:44:06.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.675870] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89c3c44e67c13d76a33579bc","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89c3c44e67c13d76a33579bc: start","job_status":"start","queue_duration_s":0.329584,"scheduling_latency_s":0.329597} gitlab # [ 181.676613] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89c3c44e67c13d76a33579bc","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89c3c44e67c13d76a33579bc: done: 0.018823 sec","job_status":"done","queue_duration_s":0.329584,"scheduling_latency_s":0.329597,"redis_calls":13,"redis_duration_s":0.011105,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004276,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018823,"completed_at":"2026-08-15T23:44:06.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.721719] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3264d1e59c492c978d3f94df","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3264d1e59c492c978d3f94df: start","job_status":"start","queue_duration_s":0.349279,"scheduling_latency_s":0.349293} gitlab # [ 181.722558] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3264d1e59c492c978d3f94df","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3264d1e59c492c978d3f94df: done: 0.008894 sec","job_status":"done","queue_duration_s":0.349279,"scheduling_latency_s":0.349293,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008894,"completed_at":"2026-08-15T23:44:06.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.766518] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4baf3afb09a744e4e8d7f8e5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4baf3afb09a744e4e8d7f8e5: start","job_status":"start","queue_duration_s":0.35898,"scheduling_latency_s":0.358994} gitlab # [ 181.767228] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4baf3afb09a744e4e8d7f8e5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4baf3afb09a744e4e8d7f8e5: done: 0.008721 sec","job_status":"done","queue_duration_s":0.35898,"scheduling_latency_s":0.358994,"redis_calls":13,"redis_duration_s":0.001452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008721,"completed_at":"2026-08-15T23:44:06.081Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.783471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ac5eb60c5c709a886ba7e22","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ac5eb60c5c709a886ba7e22: start","job_status":"start","queue_duration_s":0.36866,"scheduling_latency_s":0.368673} gitlab # [ 181.793550] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ac5eb60c5c709a886ba7e22","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ac5eb60c5c709a886ba7e22: done: 0.008802 sec","job_status":"done","queue_duration_s":0.36866,"scheduling_latency_s":0.368673,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008802,"completed_at":"2026-08-15T23:44:06.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.838651] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a06fdff3d6e56da2f5658a9","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a06fdff3d6e56da2f5658a9: start","job_status":"start","queue_duration_s":0.378437,"scheduling_latency_s":0.378451} gitlab # [ 181.839474] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a06fdff3d6e56da2f5658a9","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a06fdff3d6e56da2f5658a9: done: 0.017947 sec","job_status":"done","queue_duration_s":0.378437,"scheduling_latency_s":0.378451,"redis_calls":13,"redis_duration_s":0.010351,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017947,"completed_at":"2026-08-15T23:44:06.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.884528] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bde699788dc5cbf3b934332f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bde699788dc5cbf3b934332f: start","job_status":"start","queue_duration_s":0.399216,"scheduling_latency_s":0.399231} gitlab # [ 181.885180] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bde699788dc5cbf3b934332f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bde699788dc5cbf3b934332f: done: 0.009278 sec","job_status":"done","queue_duration_s":0.399216,"scheduling_latency_s":0.399231,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009278,"completed_at":"2026-08-15T23:44:06.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.926559] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4a249a88772689bbcb6168","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4a249a88772689bbcb6168: start","job_status":"start","queue_duration_s":0.409332,"scheduling_latency_s":0.409345} gitlab # [ 181.927440] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4a249a88772689bbcb6168","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4a249a88772689bbcb6168: done: 0.008825 sec","job_status":"done","queue_duration_s":0.409332,"scheduling_latency_s":0.409345,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008825,"completed_at":"2026-08-15T23:44:06.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 181.970520] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3252ecae51499e701a4cf356","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3252ecae51499e701a4cf356: start","job_status":"start","queue_duration_s":0.41897,"scheduling_latency_s":0.418983} gitlab # [ 181.971189] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3252ecae51499e701a4cf356","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3252ecae51499e701a4cf356: done: 0.009281 sec","job_status":"done","queue_duration_s":0.41897,"scheduling_latency_s":0.418983,"redis_calls":13,"redis_duration_s":0.001452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009281,"completed_at":"2026-08-15T23:44:06.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.005540] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30401c9f9dcfe3c70e2dad1f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30401c9f9dcfe3c70e2dad1f: start","job_status":"start","queue_duration_s":0.429032,"scheduling_latency_s":0.429045} gitlab # [ 182.006206] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30401c9f9dcfe3c70e2dad1f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30401c9f9dcfe3c70e2dad1f: done: 0.012567 sec","job_status":"done","queue_duration_s":0.429032,"scheduling_latency_s":0.429045,"redis_calls":13,"redis_duration_s":0.005058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004581,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012567,"completed_at":"2026-08-15T23:44:06.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.058300] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46b02ce7a68dd29f308c764","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46b02ce7a68dd29f308c764: start","job_status":"start","queue_duration_s":0.442427,"scheduling_latency_s":0.442442} gitlab # [ 182.058930] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46b02ce7a68dd29f308c764","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46b02ce7a68dd29f308c764: done: 0.008818 sec","job_status":"done","queue_duration_s":0.442427,"scheduling_latency_s":0.442442,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008818,"completed_at":"2026-08-15T23:44:06.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.068880] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ab842f6e60efd0dd3fef542","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ab842f6e60efd0dd3fef542: start","job_status":"start","queue_duration_s":0.452192,"scheduling_latency_s":0.452206} gitlab # [ 182.112604] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ab842f6e60efd0dd3fef542","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ab842f6e60efd0dd3fef542: done: 0.008856 sec","job_status":"done","queue_duration_s":0.452192,"scheduling_latency_s":0.452206,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008856,"completed_at":"2026-08-15T23:44:06.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.113609] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8652f226b6247873c2d01ee","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8652f226b6247873c2d01ee: start","job_status":"start","queue_duration_s":0.461851,"scheduling_latency_s":0.461864} gitlab # [ 182.119552] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8652f226b6247873c2d01ee","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8652f226b6247873c2d01ee: done: 0.008892 sec","job_status":"done","queue_duration_s":0.461851,"scheduling_latency_s":0.461864,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008892,"completed_at":"2026-08-15T23:44:06.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.151664] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b3254516d338dbd083ab2a","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b3254516d338dbd083ab2a: start","job_status":"start","queue_duration_s":0.476169,"scheduling_latency_s":0.476184} gitlab # [ 182.161730] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4b3254516d338dbd083ab2a","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4b3254516d338dbd083ab2a: done: 0.013031 sec","job_status":"done","queue_duration_s":0.476169,"scheduling_latency_s":0.476184,"redis_calls":13,"redis_duration_s":0.004366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013031,"completed_at":"2026-08-15T23:44:06.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.204039] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac48c7102024a69d548dd0e5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac48c7102024a69d548dd0e5: start","job_status":"start","queue_duration_s":0.490203,"scheduling_latency_s":0.490217} gitlab # [ 182.204669] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac48c7102024a69d548dd0e5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac48c7102024a69d548dd0e5: done: 0.00905 sec","job_status":"done","queue_duration_s":0.490203,"scheduling_latency_s":0.490217,"redis_calls":13,"redis_duration_s":0.0016610000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00905,"completed_at":"2026-08-15T23:44:06.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.241328] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99ae0c3fa5a8eeb596a59f5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99ae0c3fa5a8eeb596a59f5: start","job_status":"start","queue_duration_s":0.500079,"scheduling_latency_s":0.500092} gitlab # [ 182.243345] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99ae0c3fa5a8eeb596a59f5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99ae0c3fa5a8eeb596a59f5: done: 0.008861 sec","job_status":"done","queue_duration_s":0.500079,"scheduling_latency_s":0.500092,"redis_calls":13,"redis_duration_s":0.0014459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008861,"completed_at":"2026-08-15T23:44:06.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.275174] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c519fd9ce3dedc6f71ecaded","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c519fd9ce3dedc6f71ecaded: start","job_status":"start","queue_duration_s":0.509756,"scheduling_latency_s":0.509768} gitlab # [ 182.285502] postgres[2421]: [2421] ERROR: relation "table_without_models" does not exist gitlab # [ 182.286148] postgres[2421]: [2421] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 182.286979] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c519fd9ce3dedc6f71ecaded","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c519fd9ce3dedc6f71ecaded: done: 0.014887 sec","job_status":"done","queue_duration_s":0.509756,"scheduling_latency_s":0.509768,"redis_calls":13,"redis_duration_s":0.007227,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014887,"completed_at":"2026-08-15T23:44:06.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.328654] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"296c5dab8fbfa3570338c6ba","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-296c5dab8fbfa3570338c6ba: start","job_status":"start","queue_duration_s":0.525523,"scheduling_latency_s":0.525539} gitlab # [ 182.329430] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"296c5dab8fbfa3570338c6ba","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-296c5dab8fbfa3570338c6ba: done: 0.009034 sec","job_status":"done","queue_duration_s":0.525523,"scheduling_latency_s":0.525539,"redis_calls":13,"redis_duration_s":0.0014939999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009034,"completed_at":"2026-08-15T23:44:06.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.365606] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6417dc74ece6d340414ac8d9","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6417dc74ece6d340414ac8d9: start","job_status":"start","queue_duration_s":0.535376,"scheduling_latency_s":0.535389} gitlab # [ 182.400122] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6417dc74ece6d340414ac8d9","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6417dc74ece6d340414ac8d9: done: 0.009924 sec","job_status":"done","queue_duration_s":0.535376,"scheduling_latency_s":0.535389,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009924,"completed_at":"2026-08-15T23:44:06.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.401070] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53378010e22861d5f6b130d9","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53378010e22861d5f6b130d9: start","job_status":"start","queue_duration_s":0.546392,"scheduling_latency_s":0.546405} gitlab # [ 182.441313] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53378010e22861d5f6b130d9","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53378010e22861d5f6b130d9: done: 0.009673 sec","job_status":"done","queue_duration_s":0.546392,"scheduling_latency_s":0.546405,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009673,"completed_at":"2026-08-15T23:44:06.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.442411] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8384e00b24638446b248b0c5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8384e00b24638446b248b0c5: start","job_status":"start","queue_duration_s":0.557161,"scheduling_latency_s":0.557175} gitlab # [ 182.449780] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8384e00b24638446b248b0c5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8384e00b24638446b248b0c5: done: 0.016408 sec","job_status":"done","queue_duration_s":0.557161,"scheduling_latency_s":0.557175,"redis_calls":13,"redis_duration_s":0.003587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016408,"completed_at":"2026-08-15T23:44:06.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.492242] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438c9b39ff382d724b1af59f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438c9b39ff382d724b1af59f: start","job_status":"start","queue_duration_s":0.574384,"scheduling_latency_s":0.574398} gitlab # [ 182.492866] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438c9b39ff382d724b1af59f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438c9b39ff382d724b1af59f: done: 0.010028 sec","job_status":"done","queue_duration_s":0.574384,"scheduling_latency_s":0.574398,"redis_calls":13,"redis_duration_s":0.0014420000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010028,"completed_at":"2026-08-15T23:44:06.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.522054] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c72945553415a0517c6be4","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c72945553415a0517c6be4: start","job_status":"start","queue_duration_s":0.585216,"scheduling_latency_s":0.585229} gitlab # [ 182.564716] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32c72945553415a0517c6be4","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32c72945553415a0517c6be4: done: 0.008562 sec","job_status":"done","queue_duration_s":0.585216,"scheduling_latency_s":0.585229,"redis_calls":13,"redis_duration_s":0.0014449999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008562,"completed_at":"2026-08-15T23:44:06.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.565554] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c044fc3281cd5cef56fedd8","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c044fc3281cd5cef56fedd8: start","job_status":"start","queue_duration_s":0.594632,"scheduling_latency_s":0.594645} gitlab # [ 182.572968] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c044fc3281cd5cef56fedd8","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c044fc3281cd5cef56fedd8: done: 0.008956 sec","job_status":"done","queue_duration_s":0.594632,"scheduling_latency_s":0.594645,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008956,"completed_at":"2026-08-15T23:44:06.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.626226] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f46ef3903fe7b94cf288f00","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f46ef3903fe7b94cf288f00: start","job_status":"start","queue_duration_s":0.60444,"scheduling_latency_s":0.604454} gitlab # [ 182.626909] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f46ef3903fe7b94cf288f00","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f46ef3903fe7b94cf288f00: done: 0.008824 sec","job_status":"done","queue_duration_s":0.60444,"scheduling_latency_s":0.604454,"redis_calls":13,"redis_duration_s":0.0016289999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008824,"completed_at":"2026-08-15T23:44:06.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.667662] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac4cf805086779c2d5d83c5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac4cf805086779c2d5d83c5: start","job_status":"start","queue_duration_s":0.614132,"scheduling_latency_s":0.614146} gitlab # [ 182.668241] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac4cf805086779c2d5d83c5","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac4cf805086779c2d5d83c5: done: 0.008847 sec","job_status":"done","queue_duration_s":0.614132,"scheduling_latency_s":0.614146,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008847,"completed_at":"2026-08-15T23:44:06.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.710576] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86798eb1d6d6026c49c1f45b","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86798eb1d6d6026c49c1f45b: start","job_status":"start","queue_duration_s":0.623802,"scheduling_latency_s":0.623815} gitlab # [ 182.711230] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86798eb1d6d6026c49c1f45b","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86798eb1d6d6026c49c1f45b: done: 0.008726 sec","job_status":"done","queue_duration_s":0.623802,"scheduling_latency_s":0.623815,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008726,"completed_at":"2026-08-15T23:44:06.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.750600] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"289531c620f372f9d34b9eb7","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-289531c620f372f9d34b9eb7: start","job_status":"start","queue_duration_s":0.633346,"scheduling_latency_s":0.633358} gitlab # [ 182.751191] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"289531c620f372f9d34b9eb7","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-289531c620f372f9d34b9eb7: done: 0.008647 sec","job_status":"done","queue_duration_s":0.633346,"scheduling_latency_s":0.633358,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008647,"completed_at":"2026-08-15T23:44:06.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.789623] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70c35f16c271189f03e48e21","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70c35f16c271189f03e48e21: start","job_status":"start","queue_duration_s":0.64277,"scheduling_latency_s":0.642784} gitlab # [ 182.790438] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70c35f16c271189f03e48e21","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70c35f16c271189f03e48e21: done: 0.008701 sec","job_status":"done","queue_duration_s":0.64277,"scheduling_latency_s":0.642784,"redis_calls":13,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008701,"completed_at":"2026-08-15T23:44:06.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.834259] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"789dc4c102dd560ce9e83214","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-789dc4c102dd560ce9e83214: start","job_status":"start","queue_duration_s":0.652362,"scheduling_latency_s":0.652376} gitlab # [ 182.834837] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"789dc4c102dd560ce9e83214","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-789dc4c102dd560ce9e83214: done: 0.008722 sec","job_status":"done","queue_duration_s":0.652362,"scheduling_latency_s":0.652376,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008722,"completed_at":"2026-08-15T23:44:06.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.882689] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e566db72ae0c31a9f46bbf36","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e566db72ae0c31a9f46bbf36: start","job_status":"start","queue_duration_s":0.661877,"scheduling_latency_s":0.66189} gitlab # [ 182.883510] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e566db72ae0c31a9f46bbf36","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e566db72ae0c31a9f46bbf36: done: 0.012397 sec","job_status":"done","queue_duration_s":0.661877,"scheduling_latency_s":0.66189,"redis_calls":13,"redis_duration_s":0.0018579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012397,"completed_at":"2026-08-15T23:44:06.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.892043] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4089efbf7601a53e899f5117","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4089efbf7601a53e899f5117: start","job_status":"start","queue_duration_s":0.675349,"scheduling_latency_s":0.675363} gitlab # [ 182.926925] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4089efbf7601a53e899f5117","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4089efbf7601a53e899f5117: done: 0.012065 sec","job_status":"done","queue_duration_s":0.675349,"scheduling_latency_s":0.675363,"redis_calls":13,"redis_duration_s":0.002199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012065,"completed_at":"2026-08-15T23:44:06.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 182.932973] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93528144e5aee4891e108da3","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93528144e5aee4891e108da3: start","job_status":"start","queue_duration_s":0.688518,"scheduling_latency_s":0.688539} gitlab # [ 182.942976] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93528144e5aee4891e108da3","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93528144e5aee4891e108da3: done: 0.015026 sec","job_status":"done","queue_duration_s":0.688518,"scheduling_latency_s":0.688539,"redis_calls":13,"redis_duration_s":0.002385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015026,"completed_at":"2026-08-15T23:44:06.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.000166] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0597fc78a542e6782f916acb","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0597fc78a542e6782f916acb: start","job_status":"start","queue_duration_s":0.704388,"scheduling_latency_s":0.704402} gitlab # [ 183.000819] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0597fc78a542e6782f916acb","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0597fc78a542e6782f916acb: done: 0.009141 sec","job_status":"done","queue_duration_s":0.704388,"scheduling_latency_s":0.704402,"redis_calls":13,"redis_duration_s":0.001789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009141,"completed_at":"2026-08-15T23:44:06.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.016217] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4761014b794511db54714ff","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4761014b794511db54714ff: start","job_status":"start","queue_duration_s":0.714403,"scheduling_latency_s":0.714416} gitlab # [ 183.026249] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4761014b794511db54714ff","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4761014b794511db54714ff: done: 0.008854 sec","job_status":"done","queue_duration_s":0.714403,"scheduling_latency_s":0.714416,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008854,"completed_at":"2026-08-15T23:44:06.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.074074] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f94ff849f0f8182b14978c17","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f94ff849f0f8182b14978c17: start","job_status":"start","queue_duration_s":0.724105,"scheduling_latency_s":0.724118} gitlab # [ 183.074812] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f94ff849f0f8182b14978c17","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f94ff849f0f8182b14978c17: done: 0.00881 sec","job_status":"done","queue_duration_s":0.724105,"scheduling_latency_s":0.724118,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00881,"completed_at":"2026-08-15T23:44:06.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.099485] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94032d743bee1554a80e04c7","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94032d743bee1554a80e04c7: start","job_status":"start","queue_duration_s":0.733845,"scheduling_latency_s":0.733859} gitlab # [ 183.109600] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94032d743bee1554a80e04c7","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94032d743bee1554a80e04c7: done: 0.011355 sec","job_status":"done","queue_duration_s":0.733845,"scheduling_latency_s":0.733859,"redis_calls":13,"redis_duration_s":0.001777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011355,"completed_at":"2026-08-15T23:44:06.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.147111] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e757339a945419a0b6f6fad6","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e757339a945419a0b6f6fad6: start","job_status":"start","queue_duration_s":0.746244,"scheduling_latency_s":0.746257} gitlab # [ 183.183609] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e757339a945419a0b6f6fad6","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e757339a945419a0b6f6fad6: done: 0.009032 sec","job_status":"done","queue_duration_s":0.746244,"scheduling_latency_s":0.746257,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009032,"completed_at":"2026-08-15T23:44:06.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.184474] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"639b90091135b6065f067c63","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-639b90091135b6065f067c63: start","job_status":"start","queue_duration_s":0.756181,"scheduling_latency_s":0.756194} gitlab # [ 183.191426] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"639b90091135b6065f067c63","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-639b90091135b6065f067c63: done: 0.0087 sec","job_status":"done","queue_duration_s":0.756181,"scheduling_latency_s":0.756194,"redis_calls":13,"redis_duration_s":0.001603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0087,"completed_at":"2026-08-15T23:44:06.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.223193] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"672a2a0771a5bba08cecbd59","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-672a2a0771a5bba08cecbd59: start","job_status":"start","queue_duration_s":0.765715,"scheduling_latency_s":0.765728} gitlab # [ 183.233414] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"672a2a0771a5bba08cecbd59","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-672a2a0771a5bba08cecbd59: done: 0.008789 sec","job_status":"done","queue_duration_s":0.765715,"scheduling_latency_s":0.765728,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008789,"completed_at":"2026-08-15T23:44:06.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.273623] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcbe725a66d41b976c24418d","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcbe725a66d41b976c24418d: start","job_status":"start","queue_duration_s":0.775328,"scheduling_latency_s":0.775342} gitlab # [ 183.274168] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcbe725a66d41b976c24418d","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcbe725a66d41b976c24418d: done: 0.00899 sec","job_status":"done","queue_duration_s":0.775328,"scheduling_latency_s":0.775342,"redis_calls":13,"redis_duration_s":0.00153,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00899,"completed_at":"2026-08-15T23:44:06.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.305714] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87bc2b5b8e1400b17abf958f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87bc2b5b8e1400b17abf958f: start","job_status":"start","queue_duration_s":0.785165,"scheduling_latency_s":0.785177} gitlab # [ 183.315751] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87bc2b5b8e1400b17abf958f","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87bc2b5b8e1400b17abf958f: done: 0.008689 sec","job_status":"done","queue_duration_s":0.785165,"scheduling_latency_s":0.785177,"redis_calls":13,"redis_duration_s":0.001468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008689,"completed_at":"2026-08-15T23:44:06.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.365664] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"772601707fd476b416961696","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-772601707fd476b416961696: start","job_status":"start","queue_duration_s":0.794687,"scheduling_latency_s":0.7947} gitlab # [ 183.366524] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"772601707fd476b416961696","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-772601707fd476b416961696: done: 0.009354 sec","job_status":"done","queue_duration_s":0.794687,"scheduling_latency_s":0.7947,"redis_calls":13,"redis_duration_s":0.0015599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009354,"completed_at":"2026-08-15T23:44:06.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.405088] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49dd099a70d064d69a19d891","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49dd099a70d064d69a19d891: start","job_status":"start","queue_duration_s":0.804899,"scheduling_latency_s":0.804911} gitlab # [ 183.405755] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:06.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49dd099a70d064d69a19d891","created_at":"2026-08-15T23:44:05.663Z","trace_propagation_headers":{"sentry-trace":"55ad0d55245e4fcf93fca68fa30cd3f3-90f1b88a151c4ec1","baggage":"sentry-trace_id=55ad0d55245e4fcf93fca68fa30cd3f3,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a7153ee1b10e9eea479496f39c23c3af","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:05.714Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49dd099a70d064d69a19d891: done: 0.0113 sec","job_status":"done","queue_duration_s":0.804899,"scheduling_latency_s":0.804911,"redis_calls":13,"redis_duration_s":0.001843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0113,"completed_at":"2026-08-15T23:44:06.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 183.610302] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4082156009 wd_nsec: 4082156162 gitlab # [ 185.664431] runuser[2218]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 185.666260] setup-gitlab-start[2200]: + systemctl restart gitlab-sidekiq.service gitlab # [ 185.687816] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 185.689455] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:10.980Z","message":"Shutting down"} gitlab # [ 185.690471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:10.981Z","message":"Scheduler exiting..."} gitlab # [ 185.691206] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:10.981Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 185.691888] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:10.981Z","message":"Scheduler exiting..."} gitlab # [ 186.189968] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:11.482Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 186.692597] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:11.984Z","message":"Bye!"} gitlab # [ 186.708255] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-15T23:44:12.001Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1613,"worker_id":"sidekiq_0","memwd_rss_bytes":977956864,"retry":0} gitlab # [ 187.048798] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 187.051364] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 187.053055] systemd[1]: gitlab-sidekiq.service: Consumed 58.713s CPU time over 1min 54.091s wall clock time, 969.2M memory peak, 4.4M read from disk. gitlab # [ 187.061298] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 187.064317] setup-gitlab-start[2200]: + mkdir -p /var/lib/secrets gitlab # [ 187.067249] setup-gitlab-start[2200]: + echo nixbot-test-token-of-20-chars gitlab # [ 187.069564] setup-gitlab-start[2200]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 187.073675] setup-gitlab-start[2200]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 187.937652] gitaly[924]: time="2026-08-15T23:44:13.230Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.230" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 187.938827] gitaly[924]: time="2026-08-15T23:44:13.230Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.230" grpc.time_ms=0.3 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.008842] gitaly[924]: time="2026-08-15T23:44:13.301Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.081" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.301" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.010797] gitaly[924]: time="2026-08-15T23:44:13.301Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.081" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.301" grpc.time_ms=0.213 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.085662] gitaly[924]: time="2026-08-15T23:44:13.378Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD diskcache=0d003fb2-3e8d-4331-beef-d1a7907533fc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:44:23.123" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.343" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.104452] gitaly[924]: time="2026-08-15T23:44:13.378Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1580 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:44:23.123" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.343" grpc.time_ms=34.766 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.122464] gitaly[924]: time="2026-08-15T23:44:13.406Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.185" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.405" pid=924 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 188.123570] gitaly[924]: time="2026-08-15T23:44:13.406Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.185" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.405" grpc.time_ms=1.101 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.124234] gitaly[924]: time="2026-08-15T23:44:13.415Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:44:23.189" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.409" grpc.time_ms=5.572 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.205265] gitaly[924]: time="2026-08-15T23:44:13.498Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.277" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.497" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.206148] gitaly[924]: time="2026-08-15T23:44:13.498Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.277" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.497" grpc.time_ms=0.346 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.277303] gitaly[924]: time="2026-08-15T23:44:13.570Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD diskcache=f413d890-ee10-4b34-b3d8-31e02e67e2cc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:44:23.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.537" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.277901] gitaly[924]: time="2026-08-15T23:44:13.570Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:44:23.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.537" grpc.time_ms=32.977 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.308108] gitaly[924]: time="2026-08-15T23:44:13.601Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.070" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.600" pid=924 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 188.309246] gitaly[924]: time="2026-08-15T23:44:13.601Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.070" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.600" grpc.time_ms=0.424 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.331210] gitaly[924]: time="2026-08-15T23:44:13.624Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:44:23.088" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.619" grpc.time_ms=5.088 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.353251] gitaly[924]: time="2026-08-15T23:44:13.646Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:44:23.115" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.646" grpc.time_ms=0.158 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.368278] gitaly[924]: time="2026-08-15T23:44:13.661Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:44:23.130" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:13.660" grpc.time_ms=0.243 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 188.743616] gitaly[924]: time="2026-08-15T23:44:14.036Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZHJQ98SDK444Z2K93TJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:44:24.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:14.026" grpc.time_ms=9.494 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 189.085456] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:14 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2001 gitlab # [ 189.090221] setup-gitlab-start[2200]: + mkdir -p /tmp/test-flake gitlab # [ 189.092232] setup-gitlab-start[2200]: + cd /tmp/test-flake gitlab # [ 189.093946] setup-gitlab-start[2200]: + git init -b master gitlab # [ 189.104915] setup-gitlab-start[2494]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 189.107760] setup-gitlab-start[2200]: + git config user.name test gitlab # [ 189.109762] setup-gitlab-start[2200]: + git config user.email test@example.com gitlab # [ 189.111953] setup-gitlab-start[2200]: + cat gitlab # [ 189.113380] setup-gitlab-start[2200]: + git add flake.nix gitlab # [ 189.115136] setup-gitlab-start[2200]: + git commit -m 'initial commit' gitlab # [ 189.127616] setup-gitlab-start[2499]: [master (root-commit) 5d3ca79] initial commit gitlab # [ 189.128337] setup-gitlab-start[2499]: 1 file changed, 10 insertions(+) gitlab # [ 189.128985] setup-gitlab-start[2499]: create mode 100644 flake.nix gitlab # [ 189.130458] setup-gitlab-start[2200]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 189.138332] setup-gitlab-start[2200]: + git push -u origin master gitlab # [ 189.197420] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:14 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 29 gitlab # [ 189.286417] gitaly[924]: time="2026-08-15T23:44:14.578Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKMZQDSV6ZRM3QPCQJZP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:14.568" grpc.time_ms=10.101 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 189.315623] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:14 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 112 gitlab # [ 189.524211] gitaly[924]: time="2026-08-15T23:44:14.816Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:44:24.277" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:14.807" grpc.time_ms=9.024 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 189.561512] gitaly[924]: time="2026-08-15T23:44:14.854Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T23:44:44.044" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T23:44:14.844" grpc.time_ms=9.618 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 189.583060] gitaly[924]: time="2026-08-15T23:44:14.869Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M03WZKRXKECWHK09RG15XPB5 duration_ms=122ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 189.716665] gitaly[924]: time="2026-08-15T23:44:15.009Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M03WZKRXKECWHK09RG15XPB5 duration_ms=140ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 189.717819] gitaly[924]: time="2026-08-15T23:44:15.010Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:14.746" grpc.time_ms=263.564 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 189.767903] gitaly[924]: time="2026-08-15T23:44:15.060Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:15.060" grpc.time_ms=0.475 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 189.811308] gitaly[924]: time="2026-08-15T23:44:15.104Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:15.103" grpc.time_ms=0.349 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 189.845080] gitaly[924]: time="2026-08-15T23:44:15.138Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:15.137" grpc.time_ms=0.573 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 189.958401] gitaly[924]: time="2026-08-15T23:44:15.251Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:44:25.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:15.244" grpc.time_ms=6.403 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.030532] gitaly[924]: time="2026-08-15T23:44:15.323Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1561 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T23:44:25.059" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:15.299" grpc.time_ms=23.255 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.081336] gitaly[924]: time="2026-08-15T23:44:15.374Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M03WZKRXKECWHK09RG15XPB5 duration_ms=208ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 190.082820] gitaly[924]: time="2026-08-15T23:44:15.375Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:15.165" grpc.time_ms=209.859 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.097090] sidekiq-cluster[2447]: {"severity":"INFO","time":"2026-08-15T23:44:15.372Z","message":"Starting cluster with 1 processes"} gitlab # [ 190.119479] gitaly[924]: time="2026-08-15T23:44:15.412Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 diskcache=cddd0c49-9a75-4245-b3ac-a9af75e7d278 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:14.684" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.121492] gitaly[924]: time="2026-08-15T23:44:15.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=164 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13132 command.oublock=32 command.real_time_ms=719 command.spawn_token_fork_ms=0 command.system_time_ms=102 command.user_time_ms=62 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:14.684" grpc.time_ms=728.514 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.153242] gitlab-workhorse[824]: time="2026-08-15T23:44:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 190.154322] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:15 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 824 gitlab # [ 190.160587] setup-gitlab-start[2504]: To http://gitlab/root/test-flake.git gitlab # [ 190.161423] setup-gitlab-start[2504]: * [new branch] master -> master gitlab # [ 190.164664] setup-gitlab-start[2504]: branch 'master' set up to track 'origin/master'. gitlab # [ 190.168265] systemd[1]: Finished setup-gitlab.service. gitlab # [ 190.176621] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 191.12 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 191.285786] nixbot[2596]: {"ts": "2026-08-15T23:44:16.577Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 191.315642] nixbot[2596]: {"ts": "2026-08-15T23:44:16.608Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 191.344488] nixbot[2596]: {"ts": "2026-08-15T23:44:16.637Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 191.352566] nixbot[2596]: {"ts": "2026-08-15T23:44:16.645Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 191.362575] nixbot[2596]: {"ts": "2026-08-15T23:44:16.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 191.374684] nixbot[2596]: {"ts": "2026-08-15T23:44:16.667Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 191.383422] nixbot[2596]: {"ts": "2026-08-15T23:44:16.676Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 191.390882] nixbot[2596]: {"ts": "2026-08-15T23:44:16.683Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 191.401953] nixbot[2596]: {"ts": "2026-08-15T23:44:16.694Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 191.405405] nixbot[2596]: {"ts": "2026-08-15T23:44:16.698Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 191.412829] nixbot[2596]: {"ts": "2026-08-15T23:44:16.705Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 191.424284] nixbot[2596]: {"ts": "2026-08-15T23:44:16.717Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 191.431895] nixbot[2596]: {"ts": "2026-08-15T23:44:16.724Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 191.437991] nixbot[2596]: {"ts": "2026-08-15T23:44:16.730Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 191.447901] nixbot[2596]: {"ts": "2026-08-15T23:44:16.740Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 191.454739] nixbot[2596]: {"ts": "2026-08-15T23:44:16.747Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 191.461106] nixbot[2596]: {"ts": "2026-08-15T23:44:16.754Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 191.466975] nixbot[2596]: {"ts": "2026-08-15T23:44:16.759Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 191.476484] nixbot[2596]: {"ts": "2026-08-15T23:44:16.769Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 191.483303] nixbot[2596]: {"ts": "2026-08-15T23:44:16.776Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 191.489608] nixbot[2596]: {"ts": "2026-08-15T23:44:16.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 191.500589] nixbot[2596]: {"ts": "2026-08-15T23:44:16.793Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 191.507205] nixbot[2596]: {"ts": "2026-08-15T23:44:16.800Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 191.513570] nixbot[2596]: {"ts": "2026-08-15T23:44:16.806Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 191.519063] nixbot[2596]: {"ts": "2026-08-15T23:44:16.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 191.836798] nixbot[2596]: INFO: Started server process [2596] gitlab # [ 191.838109] nixbot[2596]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 191.854570] nixbot[2596]: INFO: ::ffff:127.0.0.1:52892 - "GET /health HTTP/1.1" 200 OK gitlab # [ 191.859318] systemd[1]: Started nixbot CI service. gitlab # [ 191.860641] systemd[1]: Reached target Multi-User System. gitlab # [ 191.861781] systemd[1]: Startup finished in 1.137s (kernel) + 3.638s (initrd) + 3min 7.085s (userspace) = 3min 11.861s. gitlab # [ 192.062549] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:17 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 207 gitlab # [ 192.067989] nixbot[2596]: {"ts": "2026-08-15T23:44:17.356Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 192.079852] nixbot[2596]: {"ts": "2026-08-15T23:44:17.372Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 192.198983] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 110 gitlab # [ 192.200653] nixbot[2596]: {"ts": "2026-08-15T23:44:17.493Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 192.202973] nixbot[2596]: {"ts": "2026-08-15T23:44:17.495Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 192.303117] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 90 gitlab # [ 192.309360] nixbot[2596]: {"ts": "2026-08-15T23:44:17.601Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 192.467982] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:17 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 144 gitlab # [ 192.474037] nixbot[2596]: {"ts": "2026-08-15T23:44:17.766Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 192.527088] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 35 gitlab # [ 192.527860] nixbot[2596]: {"ts": "2026-08-15T23:44:17.818Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab: (finished: waiting for unit nixbot.service, in 2.10 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 192.638925] nixbot[2596]: INFO: ::ffff:127.0.0.1:52908 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 192.673732] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:17 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 137 gitlab # [ 192.679458] nixbot[2596]: {"ts": "2026-08-15T23:44:17.972Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 192.734153] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 61 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds) (finished: subtest: project discovered and webhook registered, in 0.10 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 192.771378] gitaly[924]: time="2026-08-15T23:44:18.063Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQ20HQ83JA24BYMF2PN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-15T23:44:48.053" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:18.053" grpc.time_ms=8.97 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.797146] gitaly[924]: time="2026-08-15T23:44:18.075Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQ20HQ83JA24BYMF2PN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:44:48.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:18.074" grpc.time_ms=0.416 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.807539] gitaly[924]: time="2026-08-15T23:44:18.084Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQ20HQ83JA24BYMF2PN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-15T23:44:28.058" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:18.078" grpc.time_ms=5.581 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 192.818531] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 121 gitlab # [ 192.820490] nixbot[2596]: {"ts": "2026-08-15T23:44:18.107Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 192.824463] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 32 gitlab # [ 192.961199] gitaly[924]: time="2026-08-15T23:44:18.253Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQ66FS467S6Z4WGPXJ58 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.247" grpc.time_ms=6.62 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 192.988672] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 136 gitlab # Enumerating objects: 5, done. gitlab # [ 192.994137] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 154 gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 193.005393] nixbot[2596]: {"ts": "2026-08-15T23:44:18.265Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 193.012979] nixbot[2596]: {"ts": "2026-08-15T23:44:18.268Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 193.062842] gitaly[924]: time="2026-08-15T23:44:18.355Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQCAWATJYJKE8ZJPSBMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.346" grpc.time_ms=8.34 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.088473] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 193.156140] gitaly[924]: time="2026-08-15T23:44:18.448Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQDVVCJXG7N7YGHD8ZGK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.439" pid=924 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 193.169528] gitaly[924]: time="2026-08-15T23:44:18.448Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQDVVCJXG7N7YGHD8ZGK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.439" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.180381] gitlab-workhorse[824]: time="2026-08-15T23:44:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 193.182089] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 86 gitlab # [ 193.183743] gitaly[924]: time="2026-08-15T23:44:18.449Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQDVVCJXG7N7YGHD8ZGK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.439" grpc.time_ms=10.121 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.204162] gitaly[924]: time="2026-08-15T23:44:18.497Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T23:44:48.089" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T23:44:18.489" grpc.time_ms=7.561 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.219060] gitaly[924]: time="2026-08-15T23:44:18.512Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQGYNGGRTA1QCJ1QZNAK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.499" pid=924 remote_ip="2001:db8:1::1" request_sha=e75bdb61ab56c677417209c6109c1491e849fffd response_bytes=223 span.kind=server system=grpc gitlab # [ 193.227404] gitaly[924]: time="2026-08-15T23:44:18.512Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQGYNGGRTA1QCJ1QZNAK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.499" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.239394] gitlab-workhorse[824]: time="2026-08-15T23:44:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 193.241046] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 51 gitlab # [ 193.242873] gitaly[924]: time="2026-08-15T23:44:18.513Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQGYNGGRTA1QCJ1QZNAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.499" grpc.time_ms=14.189 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.254753] gitaly[924]: time="2026-08-15T23:44:18.517Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH duration_ms=98ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 193.257161] gitaly[924]: time="2026-08-15T23:44:18.544Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH duration_ms=26ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 193.259550] gitaly[924]: time="2026-08-15T23:44:18.544Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:18.418" grpc.time_ms=126.393 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.276136] gitaly[924]: time="2026-08-15T23:44:18.569Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:18.568" grpc.time_ms=0.393 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.305345] gitaly[924]: time="2026-08-15T23:44:18.598Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQKWHG7JPNQAC93KRAPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.592" grpc.time_ms=5.723 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.317522] gitaly[924]: time="2026-08-15T23:44:18.603Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:18.601" grpc.time_ms=1.494 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.325990] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 193.340079] gitaly[924]: time="2026-08-15T23:44:18.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:18.632" grpc.time_ms=0.303 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.369114] gitaly[924]: time="2026-08-15T23:44:18.661Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQN8MGSTFB028VZDKG0Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.653" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 193.369849] gitlab-workhorse[824]: time="2026-08-15T23:44:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 193.370333] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 61 gitlab # [ 193.371452] gitaly[924]: time="2026-08-15T23:44:18.661Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQN8MGSTFB028VZDKG0Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.653" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.374794] gitaly[924]: time="2026-08-15T23:44:18.661Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQN8MGSTFB028VZDKG0Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.653" grpc.time_ms=8.18 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.406862] gitaly[924]: time="2026-08-15T23:44:18.699Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH duration_ms=40ns method=POST pid=924 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 193.410278] gitaly[924]: time="2026-08-15T23:44:18.703Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:18.658" grpc.time_ms=44.419 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.428067] gitaly[924]: time="2026-08-15T23:44:18.721Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH diskcache=21d85879-933c-4cf7-84e6-5fc1e2a3e1ff grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.362" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # 5d3ca79..bab46e1 master -> master gitlab # [ 193.437177] gitaly[924]: time="2026-08-15T23:44:18.721Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=112 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13133 command.oublock=32 command.real_time_ms=351 command.spawn_token_fork_ms=1 command.system_time_ms=67 command.user_time_ms=45 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.362" grpc.time_ms=358.935 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 193.448186] gitlab-workhorse[824]: time="2026-08-15T23:44:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 193.449848] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 419 gitlab # [ 193.452809] gitlab-workhorse[824]: time="2026-08-15T23:44:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=338 gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.72 seconds) gitlab # [ 193.454567] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 78 gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 193.456418] gitaly[924]: time="2026-08-15T23:44:18.741Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQQ7Y4G8EWPC9DBGJNHP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.711" pid=924 remote_ip="2001:db8:1::1" request_sha=28013ad77af0b97bfa8a9b94ad732ee5c814c2f3 response_bytes=338 span.kind=server system=grpc gitlab # [ 193.464941] gitaly[924]: time="2026-08-15T23:44:18.741Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQQ7Y4G8EWPC9DBGJNHP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.711" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 193.475904] gitaly[924]: time="2026-08-15T23:44:18.741Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQQ7Y4G8EWPC9DBGJNHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.711" grpc.time_ms=29.823 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.534597] gitaly[924]: time="2026-08-15T23:44:18.827Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQTXXJ2ZGQBASE88N0H4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.816" grpc.time_ms=11.486 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.07 seconds) gitlab # [ 193.545540] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 48 gitlab # [ 193.547676] nixbot[2596]: INFO: ::ffff:127.0.0.1:47986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab # [ 193.586245] gitaly[924]: time="2026-08-15T23:44:18.879Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQWF4W5AXW7EQJZBRVJF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.868" pid=924 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 193.586962] gitaly[924]: time="2026-08-15T23:44:18.879Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQWF4W5AXW7EQJZBRVJF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.868" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.605535] gitaly[924]: time="2026-08-15T23:44:18.898Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQWF4W5AXW7EQJZBRVJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:18.868" grpc.time_ms=10.687 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 193.606976] gitlab-workhorse[824]: time="2026-08-15T23:44:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 193.607640] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 66 gitlab # [ 193.678747] gitaly[924]: time="2026-08-15T23:44:18.971Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:44:48.169" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:18.970" grpc.time_ms=0.831 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.731717] gitaly[924]: time="2026-08-15T23:44:19.021Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T23:44:49.011" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:19.012" grpc.time_ms=9.497 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.778489] gitaly[924]: time="2026-08-15T23:44:19.070Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:44:29.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:19.057" grpc.time_ms=12.998 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.801389] gitaly[924]: time="2026-08-15T23:44:19.094Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:44:29.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:19.087" grpc.time_ms=6.235 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.863694] gitaly[924]: time="2026-08-15T23:44:19.156Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:44:29.135" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:19.156" grpc.time_ms=0.408 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.899995] gitaly[924]: time="2026-08-15T23:44:19.192Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:44:29.164" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:19.184" grpc.time_ms=7.868 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 193.963977] gitaly[924]: time="2026-08-15T23:44:19.256Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:19.256" grpc.time_ms=0.32 pid=924 span.kind=server system=grpc gitlab # [ 194.003704] gitaly[924]: time="2026-08-15T23:44:19.296Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:44:19.296" grpc.time_ms=0.291 pid=924 span.kind=server system=grpc gitlab # [ 194.021236] gitaly[924]: time="2026-08-15T23:44:19.314Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F diskcache=6f6141e7-9b14-4027-8b1a-6bb7717ff88d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:44:29.195" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:19.216" pid=924 ref=refs/keep-around/5d3ca796a42841866cd88a7a9a69b023f8433960 remote_ip="2001:db8:1::1" revision=5d3ca796a42841866cd88a7a9a69b023f8433960 span.kind=server system=grpc username=root gitlab # [ 194.031399] gitaly[924]: time="2026-08-15T23:44:19.314Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=75 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5450 command.oublock=8 command.real_time_ms=89 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:44:29.195" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:44:19.216" grpc.time_ms=98.255 pid=924 ref=refs/keep-around/5d3ca796a42841866cd88a7a9a69b023f8433960 remote_ip="2001:db8:1::1" revision=5d3ca796a42841866cd88a7a9a69b023f8433960 span.kind=server system=grpc username=root gitlab # [ 194.032287] gitaly[924]: time="2026-08-15T23:44:19.318Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:44:49.318" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:19.318" grpc.time_ms=0.396 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 194.171877] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 534 gitlab # [ 194.174175] nixbot[2596]: {"ts": "2026-08-15T23:44:19.466Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab # [ 194.186074] nixbot[2596]: {"ts": "2026-08-15T23:44:19.478Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-5d3ca796a428-0"} gitlab # [ 194.270162] systemd[1]: Started Nix Daemon. gitlab # [ 194.336331] nix-daemon[2810]: accepted connection from pid 2804, user nixbot gitlab # [ 194.415517] nix-daemon[2810]: accepted connection from pid 2817, user nixbot gitlab # [ 194.428408] nixbot[2596]: {"ts": "2026-08-15T23:44:19.721Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-5d3ca796a428-0", "argv0": "bwrap"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 194.561828] nix-daemon[2810]: accepted connection from pid 2827, user nixbot gitlab # [ 194.584083] nixbot[2596]: INFO: ::ffff:127.0.0.1:47994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 194.630983] nix-daemon[2810]: accepted connection from pid 2840, user nixbot gitlab # [ 194.646077] nix-daemon[2810]: accepted connection from pid 2827, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 195.622074] nixbot[2596]: INFO: ::ffff:127.0.0.1:48004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 196.660677] nixbot[2596]: INFO: ::ffff:127.0.0.1:48012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 197.699963] nixbot[2596]: INFO: ::ffff:127.0.0.1:48028 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 198.737689] nixbot[2596]: INFO: ::ffff:127.0.0.1:48042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 199.667825] nix-daemon[2810]: accepted connection from pid 2868, user nixbot gitlab # [ 199.701441] gitaly[924]: time="2026-08-15T23:44:24.993Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZXVG61C41VRHT0WBNG31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:44:54.191" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:24.992" grpc.time_ms=0.76 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 199.745287] gitaly[924]: time="2026-08-15T23:44:25.038Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZXVG61C41VRHT0WBNG31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:44:35.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:25.026" grpc.time_ms=10.974 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.792790] nixbot[2596]: INFO: ::ffff:127.0.0.1:48058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.05 seconds) gitlab # [ 199.830522] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 177 gitlab # [ 199.832299] nixbot[2596]: {"ts": "2026-08-15T23:44:25.122Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab # [ 199.906511] gitaly[924]: time="2026-08-15T23:44:25.199Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZY1E06GTNRWNRGDMH24M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:44:55.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:25.198" grpc.time_ms=0.783 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.105517] gitaly[924]: time="2026-08-15T23:44:25.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZY1E06GTNRWNRGDMH24M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:44:35.146" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:25.386" grpc.time_ms=11.56 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.222604] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 380 gitlab # [ 200.229196] nixbot[2596]: {"ts": "2026-08-15T23:44:25.521Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 200.828689] nixbot[2596]: INFO: ::ffff:127.0.0.1:48060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 201.866215] nixbot[2596]: INFO: ::ffff:127.0.0.1:48072 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 202.903275] nixbot[2596]: INFO: ::ffff:127.0.0.1:48084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 203.941944] nixbot[2596]: INFO: ::ffff:127.0.0.1:47318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 204.728643] nix-daemon[2810]: accepted connection from pid 2913, user nixbot gitlab # [ 204.870301] gitaly[924]: time="2026-08-15T23:44:30.162Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X02V0N4TD9ZZT9K8JQNBQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:00.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:44:30.162" grpc.time_ms=0.732 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 204.945756] gitaly[924]: time="2026-08-15T23:44:30.238Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X02V0N4TD9ZZT9K8JQNBQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:44:40.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:44:30.228" grpc.time_ms=10.475 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.976039] nixbot[2596]: INFO: ::ffff:127.0.0.1:47332 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab # [ 205.037758] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 279 gitlab # [ 205.039254] nixbot[2596]: {"ts": "2026-08-15T23:44:30.328Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab # [ 205.163344] nix-daemon[2810]: accepted connection from pid 2930, user nixbot gitlab # [ 205.265252] gitaly[924]: time="2026-08-15T23:44:30.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X0395HJDJ6F81RXVEYGAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:30.548" grpc.time_ms=8.737 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.286832] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 77 gitlab # [ 205.340956] gitaly[924]: time="2026-08-15T23:44:30.633Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X03BQNJEMQ8SAAZ2EYXRR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:30.624" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 205.362359] gitaly[924]: time="2026-08-15T23:44:30.634Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X03BQNJEMQ8SAAZ2EYXRR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:30.624" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.383414] gitaly[924]: time="2026-08-15T23:44:30.676Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X03BQNJEMQ8SAAZ2EYXRR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:44:30.624" grpc.time_ms=31.167 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.396735] gitlab-workhorse[824]: time="2026-08-15T23:44:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 205.397669] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:44:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 105 gitlab # [ 205.516860] nix-daemon[2810]: accepted connection from pid 2955, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 206.015830] nixbot[2596]: INFO: ::ffff:127.0.0.1:47344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 207.044438] nixbot[2596]: INFO: ::ffff:127.0.0.1:47358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 208.071759] nixbot[2596]: INFO: ::ffff:127.0.0.1:47374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 209.115995] nixbot[2596]: INFO: ::ffff:127.0.0.1:47390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 210.153866] nixbot[2596]: INFO: ::ffff:127.0.0.1:47392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 211.191427] nixbot[2596]: INFO: ::ffff:127.0.0.1:47398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 212.226124] nixbot[2596]: INFO: ::ffff:127.0.0.1:47412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 213.261324] nixbot[2596]: INFO: ::ffff:127.0.0.1:52544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 214.298500] nixbot[2596]: INFO: ::ffff:127.0.0.1:52552 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 215.336523] nixbot[2596]: INFO: ::ffff:127.0.0.1:52562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 215.696719] sidekiq-cluster[2591]: 2026-08-15T23:44:40.988Z pid=2591 tid=xbr INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2591, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>441589760} gitlab # [ 215.875516] sidekiq-cluster[2591]: W, [2026-08-15T23:44:41.168319 #2591] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 215.917837] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:44:41.210Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 216.375384] nixbot[2596]: INFO: ::ffff:127.0.0.1:52566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 217.413098] nixbot[2596]: INFO: ::ffff:127.0.0.1:52578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 217.655323] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:44:42.947Z","message":"GitLab reliable fetch activated!"} gitlab # [ 217.657139] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:44:42.947Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 218.450237] nixbot[2596]: INFO: ::ffff:127.0.0.1:52582 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 219.487736] nixbot[2596]: INFO: ::ffff:127.0.0.1:52592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 220.526332] nixbot[2596]: INFO: ::ffff:127.0.0.1:52602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 221.565457] nixbot[2596]: INFO: ::ffff:127.0.0.1:52608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 222.603423] nixbot[2596]: INFO: ::ffff:127.0.0.1:52618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 223.641200] nixbot[2596]: INFO: ::ffff:127.0.0.1:56284 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 224.679861] nixbot[2596]: INFO: ::ffff:127.0.0.1:56292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 225.711178] nixbot[2596]: INFO: ::ffff:127.0.0.1:56304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 226.748580] nixbot[2596]: INFO: ::ffff:127.0.0.1:56308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 227.786313] nixbot[2596]: INFO: ::ffff:127.0.0.1:56320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 228.825641] nixbot[2596]: INFO: ::ffff:127.0.0.1:56324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 229.865188] nixbot[2596]: INFO: ::ffff:127.0.0.1:56334 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 230.903975] nixbot[2596]: INFO: ::ffff:127.0.0.1:56336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 231.941662] nixbot[2596]: INFO: ::ffff:127.0.0.1:56346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 232.979736] nixbot[2596]: INFO: ::ffff:127.0.0.1:39536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 234.017577] nixbot[2596]: INFO: ::ffff:127.0.0.1:39542 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 235.055730] nixbot[2596]: INFO: ::ffff:127.0.0.1:39546 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 236.092906] nixbot[2596]: INFO: ::ffff:127.0.0.1:39558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 237.130655] nixbot[2596]: INFO: ::ffff:127.0.0.1:39570 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 237.446581] postgres[3071]: [3071] ERROR: relation "table_without_models" does not exist gitlab # [ 237.447608] postgres[3071]: [3071] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 238.166104] nixbot[2596]: INFO: ::ffff:127.0.0.1:39576 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 239.201071] nixbot[2596]: INFO: ::ffff:127.0.0.1:39578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab # [ 239.822786] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:05.115Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 239.824065] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:05.116Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 239.824845] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:05.116Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 239.825884] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:05.116Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 239.829497] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:05.120Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 240.237621] nixbot[2596]: INFO: ::ffff:127.0.0.1:39584 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 241.189778] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.481Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"eea344314180e7473c1ec8e0","created_at":"2026-08-15T23:44:13.453Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.482Z","job_size_bytes":2,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-eea344314180e7473c1ec8e0: start","job_status":"start","queue_duration_s":52.998999,"scheduling_latency_s":52.999054} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 241.274148] nixbot[2596]: INFO: ::ffff:127.0.0.1:39600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) gitlab # [ 241.356914] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.649Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"eea344314180e7473c1ec8e0","created_at":"2026-08-15T23:44:13.453Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.482Z","job_size_bytes":2,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-eea344314180e7473c1ec8e0: done: 0.168031 sec","job_status":"done","queue_duration_s":52.998999,"scheduling_latency_s":52.999054,"redis_calls":25,"redis_duration_s":0.00575,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003075,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.084596506,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.168031,"completed_at":"2026-08-15T23:45:06.649Z","load_balancing_strategy":"primary","db_duration_s":0.057397,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.431538] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.724Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cd54fda61430c54cfd2c9103","created_at":"2026-08-15T23:44:13.490Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.493Z","job_size_bytes":2,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cd54fda61430c54cfd2c9103: start","job_status":"start","queue_duration_s":53.230175,"scheduling_latency_s":53.230206} gitlab # [ 241.543366] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.836Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cd54fda61430c54cfd2c9103","created_at":"2026-08-15T23:44:13.490Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.493Z","job_size_bytes":2,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cd54fda61430c54cfd2c9103: done: 0.112028 sec","job_status":"done","queue_duration_s":53.230175,"scheduling_latency_s":53.230206,"redis_calls":14,"redis_duration_s":0.002512,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000581,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.079074296,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.112028,"completed_at":"2026-08-15T23:45:06.836Z","load_balancing_strategy":"primary","db_duration_s":0.017393,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.545771] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.837Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"60257ad95dd2ab1a1cd18e91","created_at":"2026-08-15T23:44:13.953Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.958Z","job_size_bytes":5,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-60257ad95dd2ab1a1cd18e91: start","job_status":"start","queue_duration_s":52.878534,"scheduling_latency_s":52.878549} gitlab # [ 241.645693] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.938Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"60257ad95dd2ab1a1cd18e91","created_at":"2026-08-15T23:44:13.953Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.958Z","job_size_bytes":5,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-60257ad95dd2ab1a1cd18e91: done: 0.101182 sec","job_status":"done","queue_duration_s":52.878534,"scheduling_latency_s":52.878549,"redis_calls":12,"redis_duration_s":0.001577,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000359,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244444,"duration_s":0.101182,"completed_at":"2026-08-15T23:45:06.938Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012017,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.647379] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:06.939Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"40e8c1c90b4291f581def3e9","created_at":"2026-08-15T23:44:13.978Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.982Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-40e8c1c90b4291f581def3e9: start","job_status":"start","queue_duration_s":52.957046,"scheduling_latency_s":52.95706} gitlab # [ 241.794224] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.086Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"40e8c1c90b4291f581def3e9","created_at":"2026-08-15T23:44:13.978Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.982Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-40e8c1c90b4291f581def3e9: done: 0.147333 sec","job_status":"done","queue_duration_s":52.957046,"scheduling_latency_s":52.95706,"redis_calls":11,"redis_duration_s":0.0023220000000000003,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.123,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.123,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283556,"duration_s":0.147333,"completed_at":"2026-08-15T23:45:07.086Z","load_balancing_strategy":"primary","db_duration_s":0.067148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.796639] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.087Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"2986afe7bc02d004cf07657d","created_at":"2026-08-15T23:44:13.984Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.987Z","job_size_bytes":89,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-2986afe7bc02d004cf07657d: start","job_status":"start","queue_duration_s":53.100395,"scheduling_latency_s":53.100411} gitlab # [ 241.826280] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.113Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"2986afe7bc02d004cf07657d","created_at":"2026-08-15T23:44:13.984Z","trace_propagation_headers":{"sentry-trace":"74666b13604b4efb8ff6f9c1636ab84a-2345138cf7144b4c","baggage":"sentry-trace_id=74666b13604b4efb8ff6f9c1636ab84a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZHJQ98SDK444Z2K93TJD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:13.987Z","job_size_bytes":89,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-2986afe7bc02d004cf07657d: done: 0.025731 sec","job_status":"done","queue_duration_s":53.100395,"scheduling_latency_s":53.100411,"redis_calls":11,"redis_duration_s":0.002263,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000618,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000395,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000266235,"duration_s":0.025731,"completed_at":"2026-08-15T23:45:07.113Z","load_balancing_strategy":"primary","db_duration_s":0.005065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.884412] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.114Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 5d3ca796a42841866cd88a7a9a69b023f8433960 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"344b5bedb3dbe9e21302d027","created_at":"2026-08-15T23:44:15.195Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-f0fa257a7a4442e1","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:15.215Z","job_size_bytes":185,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-344b5bedb3dbe9e21302d027: start","job_status":"start","queue_duration_s":51.899475,"scheduling_latency_s":51.899488} gitlab # [ 241.890728] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.125Z","message":"changes: \"0000000000000000000000000000000000000000 5d3ca796a42841866cd88a7a9a69b023f8433960 refs/heads/master\\n\""} gitlab # [ 241.893378] gitaly[924]: time="2026-08-15T23:45:07.160Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:17.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.149" grpc.time_ms=10.658 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.936533] gitaly[924]: time="2026-08-15T23:45:07.173Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:45:17.023" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:07.163" grpc.time_ms=9.633 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.937384] gitaly[924]: time="2026-08-15T23:45:07.214Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T23:45:17.068" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.208" grpc.time_ms=5.575 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.965213] gitaly[924]: time="2026-08-15T23:45:07.258Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:07.257" grpc.time_ms=0.438 pid=924 span.kind=server system=grpc gitlab # [ 241.989612] gitaly[924]: time="2026-08-15T23:45:07.282Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:07.282" grpc.time_ms=0.227 pid=924 span.kind=server system=grpc gitlab # [ 242.004171] gitaly[924]: time="2026-08-15T23:45:07.297Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 diskcache=944842ac-3399-4635-b4d3-0d79416d69ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:45:17.080" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:07.220" pid=924 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 242.004779] gitaly[924]: time="2026-08-15T23:45:07.297Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4929 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=25 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:45:17.080" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:07.220" grpc.time_ms=76.379 pid=924 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 242.015124] gitaly[924]: time="2026-08-15T23:45:07.308Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:45:17.167" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:07.307" grpc.time_ms=0.101 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.024063] gitaly[924]: time="2026-08-15T23:45:07.317Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T23:45:17.170" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.310" grpc.time_ms=6.669 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.075922] gitaly[924]: time="2026-08-15T23:45:07.368Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-15T23:45:37.064" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:07.364" grpc.time_ms=3.912 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.112294] gitaly[924]: time="2026-08-15T23:45:07.405Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:45:17.264" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:07.404" grpc.time_ms=0.204 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.118399] gitaly[924]: time="2026-08-15T23:45:07.411Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T23:45:17.267" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T23:45:07.407" grpc.time_ms=3.854 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.155398] gitaly[924]: time="2026-08-15T23:45:07.448Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:17.299" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.439" grpc.time_ms=8.879 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.169807] gitaly[924]: time="2026-08-15T23:45:07.462Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:17.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.454" grpc.time_ms=8.584 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.196330] gitaly[924]: time="2026-08-15T23:45:07.489Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:45:37.173" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:07.473" grpc.time_ms=15.087 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 242.318867] nixbot[2596]: INFO: ::ffff:127.0.0.1:39608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.05 seconds) gitlab # [ 242.562226] gitaly[924]: time="2026-08-15T23:45:07.855Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T23:45:17.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:07.853" grpc.time_ms=0.98 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.622344] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.914Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 5d3ca796a42841866cd88a7a9a69b023f8433960 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"344b5bedb3dbe9e21302d027","created_at":"2026-08-15T23:44:15.195Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-f0fa257a7a4442e1","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:15.215Z","job_size_bytes":185,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-344b5bedb3dbe9e21302d027: done: 0.799562 sec","job_status":"done","queue_duration_s":51.899475,"scheduling_latency_s":51.899488,"gitaly_calls":13,"gitaly_duration_s":0.233574,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.037975,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.00328,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006449,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001311,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00384,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.012293,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010802,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.182,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.195,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.47916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000422679,"exclusive_lock_hold_duration_s":0.028085693000000002,"duration_s":0.799562,"completed_at":"2026-08-15T23:45:07.914Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072493,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.686728] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.916Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","5d3ca796a42841866cd88a7a9a69b023f8433960 bab46e10efbb7ab90611caa355c0e1e6dec5cba9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6b429c47028ee14079c8ad02","created_at":"2026-08-15T23:44:18.687Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-00176060e4354f69","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:18.688Z","job_size_bytes":185,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6b429c47028ee14079c8ad02: start","job_status":"start","queue_duration_s":49.227624,"scheduling_latency_s":49.227655} gitlab # [ 242.687495] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.930Z","message":"changes: \"5d3ca796a42841866cd88a7a9a69b023f8433960 bab46e10efbb7ab90611caa355c0e1e6dec5cba9 refs/heads/master\\n\""} gitlab # [ 242.687883] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:07.969Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b88ed75a0e86a28a06d3416f","created_at":"2026-08-15T23:45:07.968Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"0911c0e2e6cb834f546b2b3e","job_size_bytes":46,"pid":2591,"job_status":"deduplicated","message":"ProjectCacheWorker JID-b88ed75a0e86a28a06d3416f: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 242.688494] gitaly[924]: time="2026-08-15T23:45:07.953Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:17.093" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.943" grpc.time_ms=10.145 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.693982] gitaly[924]: time="2026-08-15T23:45:07.966Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:45:17.107" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:07.957" grpc.time_ms=9.146 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.736741] gitaly[924]: time="2026-08-15T23:45:07.988Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T23:45:17.128" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:07.978" grpc.time_ms=10.161 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.737497] gitaly[924]: time="2026-08-15T23:45:08.002Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-15T23:45:37.693" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:07.994" grpc.time_ms=8.427 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.738084] gitaly[924]: time="2026-08-15T23:45:08.019Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T23:45:18.003" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T23:45:08.013" grpc.time_ms=5.71 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.744597] gitaly[924]: time="2026-08-15T23:45:08.037Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:18.018" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:08.028" grpc.time_ms=8.861 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.807503] gitaly[924]: time="2026-08-15T23:45:08.100Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T23:45:18.089" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.099" grpc.time_ms=0.79 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.829738] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.122Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","5d3ca796a42841866cd88a7a9a69b023f8433960 bab46e10efbb7ab90611caa355c0e1e6dec5cba9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6b429c47028ee14079c8ad02","created_at":"2026-08-15T23:44:18.687Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-00176060e4354f69","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:44:18.688Z","job_size_bytes":185,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6b429c47028ee14079c8ad02: done: 0.205463 sec","job_status":"done","queue_duration_s":49.227624,"scheduling_latency_s":49.227655,"gitaly_calls":7,"gitaly_duration_s":0.069226,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.01818,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.002155,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000745,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002627,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006529,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.006124,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000450616,"exclusive_lock_hold_duration_s":0.017382656,"duration_s":0.205463,"completed_at":"2026-08-15T23:45:08.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021734,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.871463] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.164Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8a2c76a12a6ce85cc96b9905","created_at":"2026-08-15T23:44:19.322Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.352Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8a2c76a12a6ce85cc96b9905: start","job_status":"start","queue_duration_s":48.8111,"scheduling_latency_s":48.81114} gitlab # [ 243.021888] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.314Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8a2c76a12a6ce85cc96b9905","created_at":"2026-08-15T23:44:19.322Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.352Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8a2c76a12a6ce85cc96b9905: done: 0.150464 sec","job_status":"done","queue_duration_s":48.8111,"scheduling_latency_s":48.81114,"redis_calls":16,"redis_duration_s":0.004402,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002224,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367645,"duration_s":0.150464,"completed_at":"2026-08-15T23:45:08.314Z","load_balancing_strategy":"primary","db_duration_s":0.021268,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.024612] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.315Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"38834daf3c7b09a10c54ab5f","created_at":"2026-08-15T23:44:19.353Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.359Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-38834daf3c7b09a10c54ab5f: start","job_status":"start","queue_duration_s":48.956163,"scheduling_latency_s":48.956178} gitlab # [ 243.097281] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.389Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"38834daf3c7b09a10c54ab5f","created_at":"2026-08-15T23:44:19.353Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.359Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-38834daf3c7b09a10c54ab5f: done: 0.073878 sec","job_status":"done","queue_duration_s":48.956163,"scheduling_latency_s":48.956178,"redis_calls":21,"redis_duration_s":0.00434,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001962,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276572,"duration_s":0.073878,"completed_at":"2026-08-15T23:45:08.389Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.113682] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.391Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b7acf51df746de1ae5b17814","created_at":"2026-08-15T23:44:19.448Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.452Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b7acf51df746de1ae5b17814: start","job_status":"start","queue_duration_s":48.938755,"scheduling_latency_s":48.93877} gitlab # [ 243.238402] gitaly[924]: time="2026-08-15T23:45:08.530Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:08.530" grpc.time_ms=0.281 pid=924 span.kind=server system=grpc gitlab # [ 243.276846] gitaly[924]: time="2026-08-15T23:45:08.569Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:08.569" grpc.time_ms=0.278 pid=924 span.kind=server system=grpc gitlab # [ 243.309354] gitaly[924]: time="2026-08-15T23:45:08.602Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:08.602" grpc.time_ms=0.282 pid=924 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 243.327545] gitaly[924]: time="2026-08-15T23:45:08.620Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F diskcache=f6043b3c-ad6b-4103-b4ac-ca442e838f9d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:38.203" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:08.504" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.335395] gitaly[924]: time="2026-08-15T23:45:08.628Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=143 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7544 command.oublock=0 command.real_time_ms=108 command.spawn_token_fork_ms=0 command.system_time_ms=104 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:38.203" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:08.504" grpc.time_ms=116.15 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.360113] nixbot[2596]: INFO: ::ffff:127.0.0.1:43668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 243.436789] gitaly[924]: time="2026-08-15T23:45:08.729Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:45:38.428" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.728" grpc.time_ms=0.807 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.505925] gitaly[924]: time="2026-08-15T23:45:08.798Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:38.497" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.797" grpc.time_ms=0.936 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.520470] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.813Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b7acf51df746de1ae5b17814","created_at":"2026-08-15T23:44:19.448Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.452Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2591,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b7acf51df746de1ae5b17814: rescheduled"} gitlab # [ 243.531332] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.823Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b7acf51df746de1ae5b17814","created_at":"2026-08-15T23:44:19.448Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-0c5405980bab474d","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:44:19.452Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b7acf51df746de1ae5b17814: done: 0.432711 sec","job_status":"done","queue_duration_s":48.938755,"scheduling_latency_s":48.93877,"gitaly_calls":3,"gitaly_duration_s":0.126041,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.02392,"redis_read_bytes":462,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001096,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001615,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.007686,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003702,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15582,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006065,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000502,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000474,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.078,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.207035,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.38235446100000003,"duration_s":0.432711,"completed_at":"2026-08-15T23:45:08.823Z","load_balancing_strategy":"primary","db_duration_s":0.088346,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.599654] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.825Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0911c0e2e6cb834f546b2b3e","created_at":"2026-08-15T23:45:07.176Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.194Z","job_size_bytes":46,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0911c0e2e6cb834f546b2b3e: start","job_status":"start","queue_duration_s":1.631571,"scheduling_latency_s":1.631596} gitlab # [ 243.600470] gitaly[924]: time="2026-08-15T23:45:08.863Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T05:45:08.856" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:08.857" grpc.time_ms=4.907 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.601025] gitaly[924]: time="2026-08-15T23:45:08.880Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T23:45:38.570" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.870" grpc.time_ms=9.695 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.615598] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.908Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0911c0e2e6cb834f546b2b3e","created_at":"2026-08-15T23:45:07.176Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.194Z","job_size_bytes":46,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0911c0e2e6cb834f546b2b3e: done: 0.082684 sec","job_status":"done","queue_duration_s":1.631571,"scheduling_latency_s":1.631596,"gitaly_calls":2,"gitaly_duration_s":0.018967,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006693,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001415,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000634,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00154,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002425,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000417092,"duration_s":0.082684,"completed_at":"2026-08-15T23:45:08.908Z","load_balancing_strategy":"primary","db_duration_s":0.011899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.660302] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.909Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a354865bdb8c7de29c51bbb0","created_at":"2026-08-15T23:45:07.203Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.205Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a354865bdb8c7de29c51bbb0: start","job_status":"start","queue_duration_s":1.703698,"scheduling_latency_s":1.703712} gitlab # [ 243.661061] gitaly[924]: time="2026-08-15T23:45:08.945Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 diskcache=ed3b3ab7-e473-4737-9ec0-2c98012e53f2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:45:08.925" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.926" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.661719] gitaly[924]: time="2026-08-15T23:45:08.946Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:45:08.925" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.926" grpc.time_ms=19.644 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.708966] gitaly[924]: time="2026-08-15T23:45:09.000Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T23:45:38.693" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:08.994" grpc.time_ms=5.598 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.709599] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.974Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a354865bdb8c7de29c51bbb0","created_at":"2026-08-15T23:45:07.203Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.205Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a354865bdb8c7de29c51bbb0: done: 0.064788 sec","job_status":"done","queue_duration_s":1.703698,"scheduling_latency_s":1.703712,"gitaly_calls":1,"gitaly_duration_s":0.021717,"redis_calls":15,"redis_duration_s":0.003391,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000547,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04825753,"duration_s":0.064788,"completed_at":"2026-08-15T23:45:08.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.748508] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:08.975Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0bc752517538abc95ae765aa","created_at":"2026-08-15T23:45:07.304Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.306Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0bc752517538abc95ae765aa: start","job_status":"start","queue_duration_s":1.669368,"scheduling_latency_s":1.669382} gitlab # [ 243.749124] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.006Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"0bc752517538abc95ae765aa","created_at":"2026-08-15T23:45:07.304Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.306Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0bc752517538abc95ae765aa: done: 0.030671 sec","job_status":"done","queue_duration_s":1.669368,"scheduling_latency_s":1.669382,"gitaly_calls":1,"gitaly_duration_s":0.007283,"redis_calls":16,"redis_duration_s":0.003238,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.00025,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001453,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030671,"completed_at":"2026-08-15T23:45:09.006Z","load_balancing_strategy":"primary","db_duration_s":0.002641,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.795758] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"07732d73cd936327732aee86","created_at":"2026-08-15T23:45:07.728Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:994bc8caa8e9248ac2edb9abb9eb10d592d27fd237ca1440d2281de07f9ea74e","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.734Z","job_size_bytes":467,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-07732d73cd936327732aee86: start","job_status":"start","queue_duration_s":1.273158,"scheduling_latency_s":1.273187} gitlab # [ 243.796525] gitaly[924]: time="2026-08-15T23:45:09.026Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:39.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.025" grpc.time_ms=0.474 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.797106] gitaly[924]: time="2026-08-15T23:45:09.033Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:45:19.017" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:09.027" grpc.time_ms=5.057 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.836756] gitaly[924]: time="2026-08-15T23:45:09.127Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:45:39.126" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.127" grpc.time_ms=0.588 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.838725] gitaly[924]: time="2026-08-15T23:45:09.131Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T23:45:39.129" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.130" grpc.time_ms=1.57 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.896481] gitaly[924]: time="2026-08-15T23:45:09.189Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:19.170" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:09.180" grpc.time_ms=8.453 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 244.334672] gitaly[924]: time="2026-08-15T23:45:09.627Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:45:39.614" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.614" grpc.time_ms=12.104 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.375050] gitaly[924]: time="2026-08-15T23:45:09.668Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03WZKRXKECWHK09RG15XPB5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T23:45:39.658" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.659" grpc.time_ms=8.575 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.395368] sidekiq-cluster[2591]: {"severity":"WARN","time":"2026-08-15T23:45:09.688Z","class":"CreatePipelineWorker","correlation_id":"01M03WZKRXKECWHK09RG15XPB5","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"5d3ca796a42841866cd88a7a9a69b023f8433960","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"5d3ca796a42841866cd88a7a9a69b023f8433960","ref":"refs/heads/master"},"retry":0} gitlab # [ 244.400488] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.693Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"07732d73cd936327732aee86","created_at":"2026-08-15T23:45:07.728Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:994bc8caa8e9248ac2edb9abb9eb10d592d27fd237ca1440d2281de07f9ea74e","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.734Z","job_size_bytes":467,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-07732d73cd936327732aee86: done: 0.685869 sec","job_status":"done","queue_duration_s":1.273158,"scheduling_latency_s":1.273187,"gitaly_calls":7,"gitaly_duration_s":0.0791,"redis_calls":51,"redis_duration_s":0.009611,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000487,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005567,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001654,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.561046,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191645,"duration_s":0.685869,"completed_at":"2026-08-15T23:45:09.693Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034119,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.438972] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.697Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9d9554ed-8bc1-48c7-8ea4-e572e7349ece\"}"],"class":"WebHookWorker","jid":"becbe4b31f5325d43735d616","created_at":"2026-08-15T23:45:07.830Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:14c5908212e3cf23ceea5cebfd08a5769b14f7db7486b342148f34a1b7b7750f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.834Z","job_size_bytes":1751,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-becbe4b31f5325d43735d616: start","job_status":"start","queue_duration_s":1.862228,"scheduling_latency_s":1.862243} gitlab # [ 244.503752] nixbot[2596]: INFO: ::ffff:127.0.0.1:43676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab # [ 244.504667] nixbot[2596]: INFO: ::ffff:127.0.0.1:43674 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.15 seconds) gitlab # [ 244.519645] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.812Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9d9554ed-8bc1-48c7-8ea4-e572e7349ece\"}"],"class":"WebHookWorker","jid":"becbe4b31f5325d43735d616","created_at":"2026-08-15T23:45:07.830Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-5e87f2050e844028","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:14c5908212e3cf23ceea5cebfd08a5769b14f7db7486b342148f34a1b7b7750f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.834Z","job_size_bytes":1751,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-becbe4b31f5325d43735d616: done: 0.115215 sec","job_status":"done","queue_duration_s":1.862228,"scheduling_latency_s":1.862243,"redis_calls":19,"redis_duration_s":0.003508,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001668,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000334,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.043373110000004544,"cpu_s":0.059364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214273,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.115215,"completed_at":"2026-08-15T23:45:09.812Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001657,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.559537] gitaly[924]: time="2026-08-15T23:45:09.852Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X19NQDAMASMJK819XFXTB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:09.845" grpc.time_ms=6.009 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 244.560594] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 36 gitlab # [ 244.572884] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.865Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8b41e61f4c28a5a43b3d3333","created_at":"2026-08-15T23:45:07.973Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"a354865bdb8c7de29c51bbb0","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.975Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8b41e61f4c28a5a43b3d3333: start","job_status":"start","queue_duration_s":1.889828,"scheduling_latency_s":1.889859} gitlab # [ 244.599404] gitaly[924]: time="2026-08-15T23:45:09.892Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH diskcache=905f0afb-24eb-435d-9ed1-28d61cee486e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:45:09.880" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.881" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.600072] gitaly[924]: time="2026-08-15T23:45:09.892Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:45:09.880" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.881" grpc.time_ms=11.101 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.616899] gitaly[924]: time="2026-08-15T23:45:09.909Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X19Q9W7SDJ6SV1KQ79W4J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:09.902" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 244.617370] gitaly[924]: time="2026-08-15T23:45:09.910Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X19Q9W7SDJ6SV1KQ79W4J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:09.902" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 244.617950] gitaly[924]: time="2026-08-15T23:45:09.910Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X19Q9W7SDJ6SV1KQ79W4J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:09.902" grpc.time_ms=8.101 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 244.618529] gitlab-workhorse[824]: time="2026-08-15T23:45:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 244.618934] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 45 gitlab # [ 244.620244] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.912Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8b41e61f4c28a5a43b3d3333","created_at":"2026-08-15T23:45:07.973Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"a354865bdb8c7de29c51bbb0","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:07.975Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8b41e61f4c28a5a43b3d3333: done: 0.047662 sec","job_status":"done","queue_duration_s":1.889828,"scheduling_latency_s":1.889859,"gitaly_calls":1,"gitaly_duration_s":0.013594,"redis_calls":12,"redis_duration_s":0.004066,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000576,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.027373032,"duration_s":0.047662,"completed_at":"2026-08-15T23:45:09.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 244.660549] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:09.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"74ef862aed533c4e3591b0e8","created_at":"2026-08-15T23:45:08.079Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b21de141d2b8f27fa4e9fde60f8c63b77fbc8198ef945904a2ccfa4c012192b8","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.081Z","job_size_bytes":467,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-74ef862aed533c4e3591b0e8: start","job_status":"start","queue_duration_s":1.838606,"scheduling_latency_s":1.838635} gitlab # [ 244.665630] gitaly[924]: time="2026-08-15T23:45:09.938Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:39.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.938" grpc.time_ms=0.411 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.706707] gitaly[924]: time="2026-08-15T23:45:09.944Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:45:19.089" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:09.939" grpc.time_ms=4.316 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.707485] nixbot[2596]: {"ts": "2026-08-15T23:45:09.982Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 244.708426] gitaly[924]: time="2026-08-15T23:45:09.970Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:45:39.069" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.970" grpc.time_ms=0.504 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.708985] gitaly[924]: time="2026-08-15T23:45:09.977Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T23:45:39.073" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:09.973" grpc.time_ms=3.268 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.710646] gitaly[924]: time="2026-08-15T23:45:10.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:19.145" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:09.996" grpc.time_ms=4.689 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.741603] gitaly[924]: time="2026-08-15T23:45:10.034Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X19V7AWPH175FCVBR9JHN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:40.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:10.033" grpc.time_ms=0.808 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.814253] gitaly[924]: time="2026-08-15T23:45:10.107Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X19V7AWPH175FCVBR9JHN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:20.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:10.098" grpc.time_ms=8.507 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 244.863954] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 165 gitlab # [ 244.865546] nixbot[2596]: {"ts": "2026-08-15T23:45:10.157Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab # [ 244.923881] gitaly[924]: time="2026-08-15T23:45:10.216Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1A0G91R3XA06VF9DFB46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:40.115" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:10.215" grpc.time_ms=0.81 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.002605] gitaly[924]: time="2026-08-15T23:45:10.295Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1A0G91R3XA06VF9DFB46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:20.196" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:10.286" grpc.time_ms=8.94 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.030307] gitaly[924]: time="2026-08-15T23:45:10.323Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=1 command.system_time_ms=32 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:45:40.285" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:10.285" grpc.time_ms=37.519 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.054352] gitaly[924]: time="2026-08-15T23:45:10.338Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQBYXY5Y15GJSRR2YRAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T23:45:40.326" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:10.326" grpc.time_ms=11.974 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.065393] sidekiq-cluster[2591]: {"severity":"WARN","time":"2026-08-15T23:45:10.349Z","class":"CreatePipelineWorker","correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"5d3ca796a42841866cd88a7a9a69b023f8433960","after":"bab46e10efbb7ab90611caa355c0e1e6dec5cba9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"bab46e10efbb7ab90611caa355c0e1e6dec5cba9","ref":"refs/heads/master"},"retry":0} gitlab # [ 245.065977] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"74ef862aed533c4e3591b0e8","created_at":"2026-08-15T23:45:08.079Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b21de141d2b8f27fa4e9fde60f8c63b77fbc8198ef945904a2ccfa4c012192b8","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.081Z","job_size_bytes":467,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-74ef862aed533c4e3591b0e8: done: 0.433204 sec","job_status":"done","queue_duration_s":1.838606,"scheduling_latency_s":1.838635,"gitaly_calls":7,"gitaly_duration_s":0.075798,"redis_calls":33,"redis_duration_s":0.006004000000000001,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000979,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003347,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.336005,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.433204,"completed_at":"2026-08-15T23:45:10.353Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016226,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.073638] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.354Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"4b27f4c1-6d56-4fff-b2f1-0582f0c07beb\"}"],"class":"WebHookWorker","jid":"5a70bf553e3293f5bb68b2ef","created_at":"2026-08-15T23:45:08.090Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e060530e409a139d1aea378cebbe96811ee747055bbbb3ec54b1f30e0d328280","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.091Z","job_size_bytes":1749,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5a70bf553e3293f5bb68b2ef: start","job_status":"start","queue_duration_s":2.262494,"scheduling_latency_s":2.262513} gitlab # [ 245.139036] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 271 gitlab # [ 245.140093] nixbot[2596]: {"ts": "2026-08-15T23:45:10.432Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab # [ 245.143569] nixbot[2596]: INFO: ::ffff:127.0.0.1:43682 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 245.159561] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.451Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"4b27f4c1-6d56-4fff-b2f1-0582f0c07beb\"}"],"class":"WebHookWorker","jid":"5a70bf553e3293f5bb68b2ef","created_at":"2026-08-15T23:45:08.090Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-caa4d24e1cef487e","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e060530e409a139d1aea378cebbe96811ee747055bbbb3ec54b1f30e0d328280","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.091Z","job_size_bytes":1749,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5a70bf553e3293f5bb68b2ef: done: 0.097525 sec","job_status":"done","queue_duration_s":2.262494,"scheduling_latency_s":2.262513,"redis_calls":14,"redis_duration_s":0.059788,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000317,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.058751,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007756572000005235,"cpu_s":0.0253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.097525,"completed_at":"2026-08-15T23:45:10.451Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.178905] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"10d2fa9501dbbdc4ea9be11c","created_at":"2026-08-15T23:45:08.487Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.493Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-10d2fa9501dbbdc4ea9be11c: start","job_status":"start","queue_duration_s":1.962575,"scheduling_latency_s":1.962613} gitlab # [ 245.181636] gitaly[924]: time="2026-08-15T23:45:10.474Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1A9677NABK70T7JF34TX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:40.473" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:10.473" grpc.time_ms=0.58 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.226942] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 63 gitlab # [ 245.227681] gitaly[924]: time="2026-08-15T23:45:10.519Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=13 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1A9RDYRCCJ7359A59824 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:10.500" grpc.time_ms=18.785 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 245.251444] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.543Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"10d2fa9501dbbdc4ea9be11c","created_at":"2026-08-15T23:45:08.487Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.493Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-10d2fa9501dbbdc4ea9be11c: done: 0.088375 sec","job_status":"done","queue_duration_s":1.962575,"scheduling_latency_s":1.962613,"redis_calls":10,"redis_duration_s":0.003069,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000486934,"duration_s":0.088375,"completed_at":"2026-08-15T23:45:10.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009902,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.252379] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.545Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"aaa9113876c07079684cf9dd","created_at":"2026-08-15T23:45:08.625Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.629Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-aaa9113876c07079684cf9dd: start","job_status":"start","queue_duration_s":1.915175,"scheduling_latency_s":1.915217} gitlab # [ 245.295625] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.569Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"aaa9113876c07079684cf9dd","created_at":"2026-08-15T23:45:08.625Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.629Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-aaa9113876c07079684cf9dd: done: 0.024062 sec","job_status":"done","queue_duration_s":1.915175,"scheduling_latency_s":1.915217,"redis_calls":10,"redis_duration_s":0.001474,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248914,"duration_s":0.024062,"completed_at":"2026-08-15T23:45:10.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.300161] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"617e7e0859c8dd02425b40c0","created_at":"2026-08-15T23:45:08.638Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.646Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-617e7e0859c8dd02425b40c0: start","job_status":"start","queue_duration_s":1.923527,"scheduling_latency_s":1.923542} gitlab # [ 245.312985] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"617e7e0859c8dd02425b40c0","created_at":"2026-08-15T23:45:08.638Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.646Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-617e7e0859c8dd02425b40c0: done: 0.024836 sec","job_status":"done","queue_duration_s":1.923527,"scheduling_latency_s":1.923542,"redis_calls":10,"redis_duration_s":0.00426,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003053,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364571,"duration_s":0.024836,"completed_at":"2026-08-15T23:45:10.595Z","load_balancing_strategy":"primary","db_duration_s":0.003084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.352674] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"dea6758649fd12921d408143","created_at":"2026-08-15T23:45:08.663Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.669Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dea6758649fd12921d408143: start","job_status":"start","queue_duration_s":1.926927,"scheduling_latency_s":1.926942} gitlab # [ 245.387740] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.620Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"dea6758649fd12921d408143","created_at":"2026-08-15T23:45:08.663Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.669Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dea6758649fd12921d408143: done: 0.024164 sec","job_status":"done","queue_duration_s":1.926927,"scheduling_latency_s":1.926942,"redis_calls":13,"redis_duration_s":0.001994,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000448,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238299,"duration_s":0.024164,"completed_at":"2026-08-15T23:45:10.620Z","load_balancing_strategy":"primary","db_duration_s":0.003579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.422827] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.621Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"675d345c02f8272004de018a","created_at":"2026-08-15T23:45:08.669Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.674Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-675d345c02f8272004de018a: start","job_status":"start","queue_duration_s":1.947115,"scheduling_latency_s":1.947129} gitlab # [ 245.423673] gitaly[924]: time="2026-08-15T23:45:10.632Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1A9677NABK70T7JF34TX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:20.094" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:10.624" grpc.time_ms=7.411 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.424303] nixbot[2596]: {"ts": "2026-08-15T23:45:10.671Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 \"HTTP/1.1 201 Created\""} gitlab # [ 245.424726] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/5d3ca796a42841866cd88a7a9a69b023f8433960 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 232 gitlab # [ 245.425207] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"675d345c02f8272004de018a","created_at":"2026-08-15T23:45:08.669Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.674Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-675d345c02f8272004de018a: done: 0.023842 sec","job_status":"done","queue_duration_s":1.947115,"scheduling_latency_s":1.947129,"redis_calls":10,"redis_duration_s":0.00316,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000443353,"duration_s":0.023842,"completed_at":"2026-08-15T23:45:10.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.460271] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7971c9997eda23cba1476ec","created_at":"2026-08-15T23:45:08.674Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.679Z","job_size_bytes":19,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7971c9997eda23cba1476ec: start","job_status":"start","queue_duration_s":1.968222,"scheduling_latency_s":1.968236} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 245.496319] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7971c9997eda23cba1476ec","created_at":"2026-08-15T23:45:08.674Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.679Z","job_size_bytes":19,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7971c9997eda23cba1476ec: done: 0.019463 sec","job_status":"done","queue_duration_s":1.968222,"scheduling_latency_s":1.968236,"redis_calls":11,"redis_duration_s":0.00168,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232711,"duration_s":0.019463,"completed_at":"2026-08-15T23:45:10.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.506346] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.668Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"254dfc5b9c741e4fc808190a","created_at":"2026-08-15T23:45:08.682Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.687Z","job_size_bytes":66,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-254dfc5b9c741e4fc808190a: start","job_status":"start","queue_duration_s":1.981009,"scheduling_latency_s":1.981022} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.05 seconds) gitlab # [ 245.519995] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.771Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"254dfc5b9c741e4fc808190a","created_at":"2026-08-15T23:45:08.682Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.687Z","job_size_bytes":66,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-254dfc5b9c741e4fc808190a: done: 0.103405 sec","job_status":"done","queue_duration_s":1.981009,"scheduling_latency_s":1.981022,"redis_calls":10,"redis_duration_s":0.003935,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000261206,"duration_s":0.103405,"completed_at":"2026-08-15T23:45:10.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.563168] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"33b5422bd0a449ef562e6ef0","created_at":"2026-08-15T23:45:08.688Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.691Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-33b5422bd0a449ef562e6ef0: start","job_status":"start","queue_duration_s":2.080683,"scheduling_latency_s":2.080699} gitlab # [ 245.568522] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"33b5422bd0a449ef562e6ef0","created_at":"2026-08-15T23:45:08.688Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.691Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-33b5422bd0a449ef562e6ef0: done: 0.026099 sec","job_status":"done","queue_duration_s":2.080683,"scheduling_latency_s":2.080699,"redis_calls":10,"redis_duration_s":0.001405,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208966,"duration_s":0.026099,"completed_at":"2026-08-15T23:45:10.798Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.604647] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e77b51cd92cf68e3e55b4e53","created_at":"2026-08-15T23:45:08.696Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.699Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e77b51cd92cf68e3e55b4e53: start","job_status":"start","queue_duration_s":2.100373,"scheduling_latency_s":2.100386} gitlab # [ 245.647119] nixbot[2596]: INFO: ::ffff:127.0.0.1:43690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab # [ 245.647781] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.822Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e77b51cd92cf68e3e55b4e53","created_at":"2026-08-15T23:45:08.696Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.699Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e77b51cd92cf68e3e55b4e53: done: 0.022658 sec","job_status":"done","queue_duration_s":2.100373,"scheduling_latency_s":2.100386,"redis_calls":10,"redis_duration_s":0.001572,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199187,"duration_s":0.022658,"completed_at":"2026-08-15T23:45:10.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.652880] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.823Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"57b628a352bacdc6d4d1769e","created_at":"2026-08-15T23:45:08.699Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.702Z","job_size_bytes":6,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-57b628a352bacdc6d4d1769e: start","job_status":"start","queue_duration_s":2.121133,"scheduling_latency_s":2.121146} gitlab # [ 245.693454] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"57b628a352bacdc6d4d1769e","created_at":"2026-08-15T23:45:08.699Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.702Z","job_size_bytes":6,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-57b628a352bacdc6d4d1769e: done: 0.017551 sec","job_status":"done","queue_duration_s":2.121133,"scheduling_latency_s":2.121146,"redis_calls":10,"redis_duration_s":0.003815,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258692,"duration_s":0.017551,"completed_at":"2026-08-15T23:45:10.840Z","load_balancing_strategy":"primary","db_duration_s":0.001361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.699867] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d3269f2ee4f8d4be92333ec5","created_at":"2026-08-15T23:45:08.702Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.705Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d3269f2ee4f8d4be92333ec5: start","job_status":"start","queue_duration_s":2.136818,"scheduling_latency_s":2.136832} gitlab # [ 245.712473] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d3269f2ee4f8d4be92333ec5","created_at":"2026-08-15T23:45:08.702Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.705Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d3269f2ee4f8d4be92333ec5: done: 0.023324 sec","job_status":"done","queue_duration_s":2.136818,"scheduling_latency_s":2.136832,"redis_calls":10,"redis_duration_s":0.002352,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224609,"duration_s":0.023324,"completed_at":"2026-08-15T23:45:10.866Z","load_balancing_strategy":"primary","db_duration_s":0.004399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.758065] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.866Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"463445435f24b4459fa56c2f","created_at":"2026-08-15T23:45:08.711Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.716Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-463445435f24b4459fa56c2f: start","job_status":"start","queue_duration_s":2.150586,"scheduling_latency_s":2.1506} gitlab # [ 245.793663] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.907Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"463445435f24b4459fa56c2f","created_at":"2026-08-15T23:45:08.711Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.716Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-463445435f24b4459fa56c2f: done: 0.040562 sec","job_status":"done","queue_duration_s":2.150586,"scheduling_latency_s":2.1506,"redis_calls":14,"redis_duration_s":0.0037199999999999998,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283277,"duration_s":0.040562,"completed_at":"2026-08-15T23:45:10.907Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.796746] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:10.908Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d5739ac1109cab880db74370","created_at":"2026-08-15T23:45:08.813Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.815Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d5739ac1109cab880db74370: start","job_status":"start","queue_duration_s":2.092786,"scheduling_latency_s":2.092799} gitlab # [ 245.809765] gitaly[924]: time="2026-08-15T23:45:11.021Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:11.020" grpc.time_ms=0.544 pid=924 span.kind=server system=grpc gitlab # [ 245.817684] gitaly[924]: time="2026-08-15T23:45:11.040Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:11.040" grpc.time_ms=0.241 pid=924 span.kind=server system=grpc gitlab # [ 245.857874] gitaly[924]: time="2026-08-15T23:45:11.059Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:11.059" grpc.time_ms=0.216 pid=924 span.kind=server system=grpc gitlab # [ 245.858539] gitaly[924]: time="2026-08-15T23:45:11.068Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F diskcache=698d6682-2c68-4d55-8cc3-07a49311b731 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:40.098" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:10.999" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.859129] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.149Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d5739ac1109cab880db74370","created_at":"2026-08-15T23:45:08.813Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.815Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2591,"job_status":"rescheduled","message":"PipelineProcessWorker JID-d5739ac1109cab880db74370: rescheduled"} gitlab # [ 245.859705] gitaly[924]: time="2026-08-15T23:45:11.068Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7701 command.oublock=0 command.real_time_ms=62 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:40.098" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:10.999" grpc.time_ms=69.352 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.863156] gitaly[924]: time="2026-08-15T23:45:11.104Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:45:41.102" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:11.102" grpc.time_ms=1.722 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.873595] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.154Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d5739ac1109cab880db74370","created_at":"2026-08-15T23:45:08.813Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-e73589ef90c34bfc","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.815Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d5739ac1109cab880db74370: done: 0.245949 sec","job_status":"done","queue_duration_s":2.092786,"scheduling_latency_s":2.092799,"gitaly_calls":3,"gitaly_duration_s":0.077519,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007977,"redis_read_bytes":149,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000418,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000695,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00186,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.002815,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000155,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000528,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.051,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.051,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10072,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.222203102,"duration_s":0.245949,"completed_at":"2026-08-15T23:45:11.154Z","load_balancing_strategy":"primary","db_duration_s":0.064925,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 245.934840] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.155Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b373b87f0bacf2889b3ccbd9","created_at":"2026-08-15T23:45:08.890Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-6faef8baf57241be","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.895Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b373b87f0bacf2889b3ccbd9: start","job_status":"start","queue_duration_s":2.259764,"scheduling_latency_s":2.259779} gitlab # [ 245.935568] gitaly[924]: time="2026-08-15T23:45:11.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03WZQZHEAQGPFFJ3Q5BQF2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:41.142" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:11.142" grpc.time_ms=0.509 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 245.938633] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.186Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b373b87f0bacf2889b3ccbd9","created_at":"2026-08-15T23:45:08.890Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-6faef8baf57241be","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:08.895Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b373b87f0bacf2889b3ccbd9: done: 0.031249 sec","job_status":"done","queue_duration_s":2.259764,"scheduling_latency_s":2.259779,"redis_calls":19,"redis_duration_s":0.002403,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000312,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000435,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00444861,"duration_s":0.031249,"completed_at":"2026-08-15T23:45:11.186Z","load_balancing_strategy":"primary","db_duration_s":0.00472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 245.975704] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.187Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","becbe4b31f5325d43735d616"],"class":"WebHooks::LogExecutionWorker","jid":"5efac8cbbd2c27565bb8fb1c","created_at":"2026-08-15T23:45:09.799Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-d7be56f7a2464137","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8de4fa1e76d6ab6109e44a52996ccfd1357085f0b59f61e168bd4bc095e003a6","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:09.806Z","job_size_bytes":2593,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5efac8cbbd2c27565bb8fb1c: start","job_status":"start","queue_duration_s":1.380792,"scheduling_latency_s":1.380807} gitlab # [ 246.015351] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.221Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","becbe4b31f5325d43735d616"],"class":"WebHooks::LogExecutionWorker","jid":"5efac8cbbd2c27565bb8fb1c","created_at":"2026-08-15T23:45:09.799Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-d7be56f7a2464137","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8de4fa1e76d6ab6109e44a52996ccfd1357085f0b59f61e168bd4bc095e003a6","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:09.806Z","job_size_bytes":2593,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5efac8cbbd2c27565bb8fb1c: done: 0.033859 sec","job_status":"done","queue_duration_s":1.380792,"scheduling_latency_s":1.380807,"redis_calls":10,"redis_duration_s":0.0013390000000000001,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222933,"duration_s":0.033859,"completed_at":"2026-08-15T23:45:11.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.025429] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.222Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5a70bf553e3293f5bb68b2ef"],"class":"WebHooks::LogExecutionWorker","jid":"b2b7df763c73d1f302e02f64","created_at":"2026-08-15T23:45:10.439Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-4cff8b6c7f384aee","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2a8754b5733a58a194162a9a4352b681bbde40e69fd216fe3721a7d3a6b0ff35","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:10.443Z","job_size_bytes":2592,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b2b7df763c73d1f302e02f64: start","job_status":"start","queue_duration_s":0.779112,"scheduling_latency_s":0.779126} gitlab # [ 246.062713] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.238Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5a70bf553e3293f5bb68b2ef"],"class":"WebHooks::LogExecutionWorker","jid":"b2b7df763c73d1f302e02f64","created_at":"2026-08-15T23:45:10.439Z","trace_propagation_headers":{"sentry-trace":"670be04b24154662908102d8e011c281-4cff8b6c7f384aee","baggage":"sentry-trace_id=670be04b24154662908102d8e011c281,sentry-release=Unknown"},"correlation_id":"01M03WZQBYXY5Y15GJSRR2YRAH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2a8754b5733a58a194162a9a4352b681bbde40e69fd216fe3721a7d3a6b0ff35","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:10.443Z","job_size_bytes":2592,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b2b7df763c73d1f302e02f64: done: 0.016107 sec","job_status":"done","queue_duration_s":0.779112,"scheduling_latency_s":0.779126,"redis_calls":7,"redis_duration_s":0.000896,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016107,"completed_at":"2026-08-15T23:45:11.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.098795] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4dc7c32bdf54a9a4ee80cfa0","created_at":"2026-08-15T23:45:10.993Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:10.994Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4dc7c32bdf54a9a4ee80cfa0: start","job_status":"start","queue_duration_s":0.244819,"scheduling_latency_s":0.244832} gitlab # [ 246.099611] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4dc7c32bdf54a9a4ee80cfa0","created_at":"2026-08-15T23:45:10.993Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:10.994Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4dc7c32bdf54a9a4ee80cfa0: done: 0.025326 sec","job_status":"done","queue_duration_s":0.244819,"scheduling_latency_s":0.244832,"redis_calls":7,"redis_duration_s":0.000892,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025326,"completed_at":"2026-08-15T23:45:11.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004388,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.137628] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3d9ee0578646fd1d2199d373","created_at":"2026-08-15T23:45:11.072Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.074Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3d9ee0578646fd1d2199d373: start","job_status":"start","queue_duration_s":0.191144,"scheduling_latency_s":0.191159} gitlab # [ 246.138343] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.281Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3d9ee0578646fd1d2199d373","created_at":"2026-08-15T23:45:11.072Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.074Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3d9ee0578646fd1d2199d373: done: 0.016043 sec","job_status":"done","queue_duration_s":0.191144,"scheduling_latency_s":0.191159,"redis_calls":7,"redis_duration_s":0.000892,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016043,"completed_at":"2026-08-15T23:45:11.281Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.174039] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.282Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"04bf39ecbe598cde1c7562ca","created_at":"2026-08-15T23:45:11.079Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.081Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-04bf39ecbe598cde1c7562ca: start","job_status":"start","queue_duration_s":0.201848,"scheduling_latency_s":0.201862} gitlab # [ 246.181940] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"04bf39ecbe598cde1c7562ca","created_at":"2026-08-15T23:45:11.079Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.081Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-04bf39ecbe598cde1c7562ca: done: 0.016372 sec","job_status":"done","queue_duration_s":0.201848,"scheduling_latency_s":0.201862,"redis_calls":7,"redis_duration_s":0.000892,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016372,"completed_at":"2026-08-15T23:45:11.299Z","load_balancing_strategy":"primary","db_duration_s":0.002501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.230148] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.300Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"92b1a3132ce8ede53021656c","created_at":"2026-08-15T23:45:11.086Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.087Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92b1a3132ce8ede53021656c: start","job_status":"start","queue_duration_s":0.212528,"scheduling_latency_s":0.212542} gitlab # [ 246.230813] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"92b1a3132ce8ede53021656c","created_at":"2026-08-15T23:45:11.086Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.087Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-92b1a3132ce8ede53021656c: done: 0.017616 sec","job_status":"done","queue_duration_s":0.212528,"scheduling_latency_s":0.212542,"redis_calls":10,"redis_duration_s":0.001242,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000356,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017616,"completed_at":"2026-08-15T23:45:11.317Z","load_balancing_strategy":"primary","db_duration_s":0.002583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.283682] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.318Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"54b7ae925e6442248c66f50b","created_at":"2026-08-15T23:45:11.087Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.088Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-54b7ae925e6442248c66f50b: start","job_status":"start","queue_duration_s":0.229777,"scheduling_latency_s":0.22979} gitlab # [ 246.284515] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"54b7ae925e6442248c66f50b","created_at":"2026-08-15T23:45:11.087Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.088Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-54b7ae925e6442248c66f50b: done: 0.016213 sec","job_status":"done","queue_duration_s":0.229777,"scheduling_latency_s":0.22979,"redis_calls":7,"redis_duration_s":0.001067,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016213,"completed_at":"2026-08-15T23:45:11.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.324979] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.335Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"20db309aa1bd0d7cc8483b6f","created_at":"2026-08-15T23:45:11.089Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.090Z","job_size_bytes":19,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-20db309aa1bd0d7cc8483b6f: start","job_status":"start","queue_duration_s":0.245231,"scheduling_latency_s":0.245244} gitlab # [ 246.325656] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"20db309aa1bd0d7cc8483b6f","created_at":"2026-08-15T23:45:11.089Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.090Z","job_size_bytes":19,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-20db309aa1bd0d7cc8483b6f: done: 0.014268 sec","job_status":"done","queue_duration_s":0.245231,"scheduling_latency_s":0.245244,"redis_calls":8,"redis_duration_s":0.001009,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014268,"completed_at":"2026-08-15T23:45:11.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.377653] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.350Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7058fc48f67642453f243bb1","created_at":"2026-08-15T23:45:11.091Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.092Z","job_size_bytes":66,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7058fc48f67642453f243bb1: start","job_status":"start","queue_duration_s":0.258768,"scheduling_latency_s":0.258781} gitlab # [ 246.378449] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.364Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7058fc48f67642453f243bb1","created_at":"2026-08-15T23:45:11.091Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.092Z","job_size_bytes":66,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7058fc48f67642453f243bb1: done: 0.013218 sec","job_status":"done","queue_duration_s":0.258768,"scheduling_latency_s":0.258781,"redis_calls":7,"redis_duration_s":0.000862,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013218,"completed_at":"2026-08-15T23:45:11.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.418152] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.364Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"133c7bbe33b7227a7316eb74","created_at":"2026-08-15T23:45:11.092Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.093Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-133c7bbe33b7227a7316eb74: start","job_status":"start","queue_duration_s":0.271131,"scheduling_latency_s":0.271145} gitlab # [ 246.419027] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.380Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"133c7bbe33b7227a7316eb74","created_at":"2026-08-15T23:45:11.092Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.093Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-133c7bbe33b7227a7316eb74: done: 0.015604 sec","job_status":"done","queue_duration_s":0.271131,"scheduling_latency_s":0.271145,"redis_calls":7,"redis_duration_s":0.000882,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015604,"completed_at":"2026-08-15T23:45:11.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.474637] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.381Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"272507c46d7897a073425bee","created_at":"2026-08-15T23:45:11.094Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.094Z","job_size_bytes":6,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-272507c46d7897a073425bee: start","job_status":"start","queue_duration_s":0.286458,"scheduling_latency_s":0.286471} gitlab # [ 246.475243] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"272507c46d7897a073425bee","created_at":"2026-08-15T23:45:11.094Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.094Z","job_size_bytes":6,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-272507c46d7897a073425bee: done: 0.008589 sec","job_status":"done","queue_duration_s":0.286458,"scheduling_latency_s":0.286471,"redis_calls":7,"redis_duration_s":0.000912,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008589,"completed_at":"2026-08-15T23:45:11.389Z","load_balancing_strategy":"primary","db_duration_s":0.00023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.526674] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.390Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6b36293b94f672f611cae5b2","created_at":"2026-08-15T23:45:11.095Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.095Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6b36293b94f672f611cae5b2: start","job_status":"start","queue_duration_s":0.294719,"scheduling_latency_s":0.294731} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab # [ 246.527552] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.404Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6b36293b94f672f611cae5b2","created_at":"2026-08-15T23:45:11.095Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.095Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6b36293b94f672f611cae5b2: done: 0.013665 sec","job_status":"done","queue_duration_s":0.294719,"scheduling_latency_s":0.294731,"redis_calls":7,"redis_duration_s":0.000858,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013665,"completed_at":"2026-08-15T23:45:11.404Z","load_balancing_strategy":"primary","db_duration_s":0.001902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.572733] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.405Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"558363b2cb71d86aaf98fd21","created_at":"2026-08-15T23:45:11.149Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.151Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-558363b2cb71d86aaf98fd21: start","job_status":"start","queue_duration_s":0.254062,"scheduling_latency_s":0.254074} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.04 seconds) gitlab # [ 246.573554] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.420Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"558363b2cb71d86aaf98fd21","created_at":"2026-08-15T23:45:11.149Z","trace_propagation_headers":{"sentry-trace":"6bfaea10868f4ca5abbeb980d066708c-c5ffda28742c41e8","baggage":"sentry-trace_id=6bfaea10868f4ca5abbeb980d066708c,sentry-release=Unknown"},"correlation_id":"01M03WZQZHEAQGPFFJ3Q5BQF2F","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.151Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-558363b2cb71d86aaf98fd21: done: 0.015029 sec","job_status":"done","queue_duration_s":0.254062,"scheduling_latency_s":0.254074,"redis_calls":8,"redis_duration_s":0.0010019999999999999,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015029,"completed_at":"2026-08-15T23:45:11.420Z","load_balancing_strategy":"primary","db_duration_s":0.002009,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 246.589714] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0de822fc08a902dd6081ea18","created_at":"2026-08-15T23:45:11.177Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-fb12f1f0a7b64cf1","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.180Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0de822fc08a902dd6081ea18: start","job_status":"start","queue_duration_s":0.240435,"scheduling_latency_s":0.240449} gitlab # [ 246.603656] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:11.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0de822fc08a902dd6081ea18","created_at":"2026-08-15T23:45:11.177Z","trace_propagation_headers":{"sentry-trace":"727e7017e83545069a4ee027ee8380ab-fb12f1f0a7b64cf1","baggage":"sentry-trace_id=727e7017e83545069a4ee027ee8380ab,sentry-release=Unknown"},"correlation_id":"01M03WZKRXKECWHK09RG15XPB5","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:11.180Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0de822fc08a902dd6081ea18: done: 0.05472 sec","job_status":"done","queue_duration_s":0.240435,"scheduling_latency_s":0.240449,"redis_calls":11,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210361,"duration_s":0.05472,"completed_at":"2026-08-15T23:45:11.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 246.672554] nixbot[2596]: INFO: ::ffff:127.0.0.1:43698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab # [ 246.713366] gitaly[924]: time="2026-08-15T23:45:12.006Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1ABTRP1A6FX3Y4TBHW1N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:11.996" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 246.714107] gitaly[924]: time="2026-08-15T23:45:12.006Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1ABTRP1A6FX3Y4TBHW1N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:11.996" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.714962] gitlab-workhorse[824]: time="2026-08-15T23:45:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 246.715594] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1484 gitlab # [ 246.716229] gitaly[924]: time="2026-08-15T23:45:12.006Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1ABTRP1A6FX3Y4TBHW1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:11.996" grpc.time_ms=9.78 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.804156] gitaly[924]: time="2026-08-15T23:45:12.097Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1BVVWYYEBRD364TRXXT6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.090" grpc.time_ms=6.116 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.814920] nix-daemon[2810]: accepted connection from pid 3323, user nixbot gitlab # [ 246.815861] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 49 gitlab # [ 246.862405] gitaly[924]: time="2026-08-15T23:45:12.155Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1BXF631GMCFGHRRQS6AB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.148" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 246.871029] gitaly[924]: time="2026-08-15T23:45:12.155Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1BXF631GMCFGHRRQS6AB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.148" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.871644] gitlab-workhorse[824]: time="2026-08-15T23:45:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 246.872055] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 44 gitlab # [ 246.872488] gitaly[924]: time="2026-08-15T23:45:12.155Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1BXF631GMCFGHRRQS6AB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.148" grpc.time_ms=6.91 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.962360] gitaly[924]: time="2026-08-15T23:45:12.255Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M03X1C0MWC5VBJ2S404KMHKM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.246" grpc.time_ms=8.475 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 246.973480] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 53 gitlab # [ 247.058276] gitaly[924]: time="2026-08-15T23:45:12.351Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C2D9E684MXPF55JN8P3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.336" pid=924 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 247.066805] gitaly[924]: time="2026-08-15T23:45:12.351Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C2D9E684MXPF55JN8P3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.336" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.078510] gitlab-workhorse[824]: time="2026-08-15T23:45:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 247.080352] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 83 gitlab # [ 247.082024] gitaly[924]: time="2026-08-15T23:45:12.351Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C2D9E684MXPF55JN8P3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:12.336" grpc.time_ms=15.365 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 247.172263] gitaly[924]: time="2026-08-15T23:45:12.465Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:42.063" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:12.464" grpc.time_ms=0.761 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.201538] gitaly[924]: time="2026-08-15T23:45:12.494Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T23:45:42.082" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:12.482" grpc.time_ms=11.612 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.228304] gitaly[924]: time="2026-08-15T23:45:12.521Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:22.290" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:12.510" grpc.time_ms=10.368 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.276168] gitaly[924]: time="2026-08-15T23:45:12.569Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:45:22.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:12.568" grpc.time_ms=0.229 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.303882] gitaly[924]: time="2026-08-15T23:45:12.596Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:45:22.025" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:12.585" grpc.time_ms=10.768 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.354163] gitaly[924]: time="2026-08-15T23:45:12.646Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:12.646" grpc.time_ms=0.914 pid=924 span.kind=server system=grpc gitlab # [ 247.391716] gitaly[924]: time="2026-08-15T23:45:12.684Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:12.684" grpc.time_ms=0.253 pid=924 span.kind=server system=grpc gitlab # [ 247.408427] gitaly[924]: time="2026-08-15T23:45:12.701Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR diskcache=f3d51e27-ac92-4e4d-a0f0-c492f659860d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:45:22.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:12.599" pid=924 ref=refs/keep-around/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 remote_ip="2001:db8:1::1" revision=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 span.kind=server system=grpc username=root gitlab # [ 247.409668] gitaly[924]: time="2026-08-15T23:45:12.701Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=96 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5338 command.oublock=8 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=59 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:45:22.039" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:45:12.599" grpc.time_ms=101.811 pid=924 ref=refs/keep-around/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 remote_ip="2001:db8:1::1" revision=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 span.kind=server system=grpc username=root gitlab # [ 247.434968] gitaly[924]: time="2026-08-15T23:45:12.727Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:42.627" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:12.727" grpc.time_ms=0.335 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.446688] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:12.738Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1980ab2efb9fd9ee151c6159","created_at":"2026-08-15T23:45:12.733Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-d3fcebe1cde44aaf","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.736Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1980ab2efb9fd9ee151c6159: start","job_status":"start","queue_duration_s":0.002164,"scheduling_latency_s":0.002214} gitlab # [ 247.486965] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:12.779Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1980ab2efb9fd9ee151c6159","created_at":"2026-08-15T23:45:12.733Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-d3fcebe1cde44aaf","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.736Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1980ab2efb9fd9ee151c6159: done: 0.040579 sec","job_status":"done","queue_duration_s":0.002164,"scheduling_latency_s":0.002214,"redis_calls":7,"redis_duration_s":0.001912,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000557,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040579,"completed_at":"2026-08-15T23:45:12.779Z","load_balancing_strategy":"primary","db_duration_s":0.004908,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.524307] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:12.816Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3917fb47a11f7dd7abec9a32","created_at":"2026-08-15T23:45:12.737Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-d3fcebe1cde44aaf","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.739Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3917fb47a11f7dd7abec9a32: start","job_status":"start","queue_duration_s":0.077666,"scheduling_latency_s":0.077705} gitlab # [ 247.563169] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 452 gitlab # [ 247.566459] nixbot[2596]: {"ts": "2026-08-15T23:45:12.859Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 \"HTTP/1.1 201 Created\""} gitlab # [ 247.578102] nixbot[2596]: {"ts": "2026-08-15T23:45:12.870Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-bab46e10efbb-4"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9', in 0.03 seconds) (finished: subtest: push delivers the webhook, in 54.90 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bab46e10efbb7ab90611caa355c0e1e6dec5cba9/statuses gitlab # [ 247.611219] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:12.903Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3917fb47a11f7dd7abec9a32","created_at":"2026-08-15T23:45:12.737Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-d3fcebe1cde44aaf","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.739Z","job_size_bytes":65,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3917fb47a11f7dd7abec9a32: done: 0.086995 sec","job_status":"done","queue_duration_s":0.077666,"scheduling_latency_s":0.077705,"redis_calls":10,"redis_duration_s":0.003452,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001559,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086995,"completed_at":"2026-08-15T23:45:12.903Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.646611] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:12.905Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e2d90972e12a4c6f227a4294","created_at":"2026-08-15T23:45:12.791Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-d3fcebe1cde44aaf","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.835Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e2d90972e12a4c6f227a4294: start","job_status":"start","queue_duration_s":0.070042,"scheduling_latency_s":0.070058} gitlab # [ 247.659279] nix-daemon[2810]: accepted connection from pid 3380, user nixbot gitlab # [ 247.660165] nixbot[2596]: INFO: ::ffff:127.0.0.1:43702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 200 OK gitlab # [ 247.699295] gitaly[924]: time="2026-08-15T23:45:12.992Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1CQWWZXMT368H35XGAYT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:42.890" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:12.991" grpc.time_ms=0.481 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.709892] gitaly[924]: time="2026-08-15T23:45:12.996Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:45:42.096" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:12.996" grpc.time_ms=0.424 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.720887] nix-daemon[2810]: accepted connection from pid 3396, user nixbot gitlab # [ 247.723474] nixbot[2596]: {"ts": "2026-08-15T23:45:13.013Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-bab46e10efbb-4", "argv0": "bwrap"} gitlab # [ 247.727666] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/bab46e10efbb7ab90611caa355c0e1e6dec5cba9/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 63 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bab46e10efbb7ab90611caa355c0e1e6dec5cba9/statuses, in 0.10 seconds) gitlab # [ 247.736328] gitaly[924]: time="2026-08-15T23:45:13.028Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1C6JS9RHYH5QM5ZA4FAR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:43.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:13.027" grpc.time_ms=0.539 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 247.753362] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e2d90972e12a4c6f227a4294","created_at":"2026-08-15T23:45:12.791Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-d3fcebe1cde44aaf","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.835Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e2d90972e12a4c6f227a4294: done: 0.140768 sec","job_status":"done","queue_duration_s":0.070042,"scheduling_latency_s":0.070058,"gitaly_calls":2,"gitaly_duration_s":0.004378,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007424,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001811,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00069,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000344,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000165,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000362,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001137,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073565,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.080817255,"duration_s":0.140768,"completed_at":"2026-08-15T23:45:13.046Z","load_balancing_strategy":"primary","db_duration_s":0.055115,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 247.785758] nix-daemon[2810]: accepted connection from pid 3408, user nixbot gitlab # [ 247.796321] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.089Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2e01d4a85a4c6fd810889aa6","created_at":"2026-08-15T23:45:12.984Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-60ee1d0189e04535","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.986Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2e01d4a85a4c6fd810889aa6: start","job_status":"start","queue_duration_s":0.10273,"scheduling_latency_s":0.102755} gitlab # [ 247.826495] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.119Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2e01d4a85a4c6fd810889aa6","created_at":"2026-08-15T23:45:12.984Z","trace_propagation_headers":{"sentry-trace":"385c3fe438b44f18a5077f31d29132b9-60ee1d0189e04535","baggage":"sentry-trace_id=385c3fe438b44f18a5077f31d29132b9,sentry-release=Unknown"},"correlation_id":"01M03X1C6JS9RHYH5QM5ZA4FAR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:12.986Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2e01d4a85a4c6fd810889aa6: done: 0.030017 sec","job_status":"done","queue_duration_s":0.10273,"scheduling_latency_s":0.102755,"redis_calls":7,"redis_duration_s":0.001012,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030017,"completed_at":"2026-08-15T23:45:13.119Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 247.831970] nix-daemon[2810]: accepted connection from pid 3418, user nixbot gitlab # [ 247.838665] nix-daemon[2810]: accepted connection from pid 3408, user nixbot gitlab # [ 248.035223] gitaly[924]: time="2026-08-15T23:45:13.328Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:43.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:13.327" grpc.time_ms=0.709 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.077195] gitaly[924]: time="2026-08-15T23:45:13.370Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:23.270" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.360" grpc.time_ms=9.239 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.113941] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.406Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c0a3b474e96a19e592a4fe2","created_at":"2026-08-15T23:45:13.402Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-8ca65b35f4574114","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.405Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5c0a3b474e96a19e592a4fe2: start","job_status":"start","queue_duration_s":0.001406,"scheduling_latency_s":0.001436} gitlab # [ 248.146231] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 170 gitlab # [ 248.148224] nixbot[2596]: {"ts": "2026-08-15T23:45:13.441Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 \"HTTP/1.1 201 Created\""} gitlab # [ 248.206854] gitaly[924]: time="2026-08-15T23:45:13.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D74KN6CA13ZXAGEMV05 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:43.398" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:13.498" grpc.time_ms=0.801 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.231787] gitaly[924]: time="2026-08-15T23:45:13.524Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:13.523" grpc.time_ms=1.368 pid=924 span.kind=server system=grpc gitlab # [ 248.243556] gitaly[924]: time="2026-08-15T23:45:13.536Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1D74KN6CA13ZXAGEMV05 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:23.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.521" grpc.time_ms=15.198 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.276855] gitaly[924]: time="2026-08-15T23:45:13.569Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:13.569" grpc.time_ms=0.348 pid=924 span.kind=server system=grpc gitlab # [ 248.277819] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 126 gitlab # [ 248.288172] nixbot[2596]: {"ts": "2026-08-15T23:45:13.580Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 \"HTTP/1.1 201 Created\""} gitlab # [ 248.308499] gitaly[924]: time="2026-08-15T23:45:13.601Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:45:13.600" grpc.time_ms=0.493 pid=924 span.kind=server system=grpc gitlab # [ 248.319481] gitaly[924]: time="2026-08-15T23:45:13.612Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:43.492" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.492" operations="[repack_refs]" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.321490] gitaly[924]: time="2026-08-15T23:45:13.614Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:43.492" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.492" pid=924 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-15 23:44:13.358884278 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 248.341078] gitaly[924]: time="2026-08-15T23:45:13.634Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:43.492" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.492" pid=924 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 248.341914] gitaly[924]: time="2026-08-15T23:45:13.634Z" level=info msg="optimized repository" clean_stale_data_time=18.605717ms clean_work_trees_time="135.492µs" commit_graph_time="6.705µs" correlation_id=01M03X1D1M49002YYH9HG42E36 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="7.264µs" pid=924 prune_time="6.425µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="7.542µs" storage_name=default system=housekeeping total_time=18.928942ms gitlab # [ 248.342474] gitaly[924]: time="2026-08-15T23:45:13.634Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:43.492" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.492" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.366275] gitaly[924]: time="2026-08-15T23:45:13.659Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 diskcache=165c5ad3-5741-439c-92f3-8eee020cab8a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:43.492" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.492" pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.374614] gitaly[924]: time="2026-08-15T23:45:13.667Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=105 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8728 command.oublock=0 command.real_time_ms=132 command.spawn_token_fork_ms=0 command.system_time_ms=77 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:45:43.492" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.492" grpc.time_ms=167.013 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.386315] gitaly[924]: time="2026-08-15T23:45:13.679Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1DBW073JRBZAVKM67C5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:43.678" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:13.678" grpc.time_ms=0.515 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.430688] gitaly[924]: time="2026-08-15T23:45:13.723Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1DBW073JRBZAVKM67C5C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:45:23.188" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:45:13.718" grpc.time_ms=5.349 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.437540] gitaly[924]: time="2026-08-15T23:45:13.730Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:45:43.729" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:13.729" grpc.time_ms=0.589 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.466844] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 163 gitlab # [ 248.467837] nixbot[2596]: {"ts": "2026-08-15T23:45:13.760Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bab46e10efbb7ab90611caa355c0e1e6dec5cba9 \"HTTP/1.1 201 Created\""} gitlab # [ 248.469034] gitaly[924]: time="2026-08-15T23:45:13.762Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1D1M49002YYH9HG42E36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:45:43.759" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:45:13.759" grpc.time_ms=2.097 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 248.479189] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.771Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"246f8943aab48beaf2fef892","created_at":"2026-08-15T23:45:13.769Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"5c0a3b474e96a19e592a4fe2","job_size_bytes":3,"pid":2591,"job_status":"deduplicated","message":"PipelineProcessWorker JID-246f8943aab48beaf2fef892: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 248.480056] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.773Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c0a3b474e96a19e592a4fe2","created_at":"2026-08-15T23:45:13.402Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-8ca65b35f4574114","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.405Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2591,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5c0a3b474e96a19e592a4fe2: rescheduled"} gitlab # [ 248.484870] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.777Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c0a3b474e96a19e592a4fe2","created_at":"2026-08-15T23:45:13.402Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-8ca65b35f4574114","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.405Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5c0a3b474e96a19e592a4fe2: done: 0.371143 sec","job_status":"done","queue_duration_s":0.001406,"scheduling_latency_s":0.001436,"gitaly_calls":3,"gitaly_duration_s":0.195382,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014564,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001365,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001487,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003383,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004364,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000332,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000858,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00141,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.133055,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.339042811,"duration_s":0.371143,"completed_at":"2026-08-15T23:45:13.777Z","load_balancing_strategy":"primary","db_duration_s":0.035842,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.511639] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.779Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8314c477bd0ffdf714760f29","created_at":"2026-08-15T23:45:13.482Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.485Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8314c477bd0ffdf714760f29: start","job_status":"start","queue_duration_s":0.293856,"scheduling_latency_s":0.293874} gitlab # [ 248.525238] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.810Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8314c477bd0ffdf714760f29","created_at":"2026-08-15T23:45:13.482Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.485Z","job_size_bytes":23,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8314c477bd0ffdf714760f29: done: 0.031704 sec","job_status":"done","queue_duration_s":0.293856,"scheduling_latency_s":0.293874,"redis_calls":7,"redis_duration_s":0.0009889999999999999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031704,"completed_at":"2026-08-15T23:45:13.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008949,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 248.576919] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.811Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ec872b18e113cc11532c9ede","created_at":"2026-08-15T23:45:13.683Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.686Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ec872b18e113cc11532c9ede: start","job_status":"start","queue_duration_s":0.12494,"scheduling_latency_s":0.124956} gitlab # [ 248.577639] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ec872b18e113cc11532c9ede","created_at":"2026-08-15T23:45:13.683Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.686Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ec872b18e113cc11532c9ede: done: 0.01963 sec","job_status":"done","queue_duration_s":0.12494,"scheduling_latency_s":0.124956,"redis_calls":7,"redis_duration_s":0.001003,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01963,"completed_at":"2026-08-15T23:45:13.831Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.623021] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"09d52487a097da30271f368f","created_at":"2026-08-15T23:45:13.694Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.696Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-09d52487a097da30271f368f: start","job_status":"start","queue_duration_s":0.135608,"scheduling_latency_s":0.135621} gitlab # [ 248.623655] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.855Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"09d52487a097da30271f368f","created_at":"2026-08-15T23:45:13.694Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.696Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-09d52487a097da30271f368f: done: 0.023584 sec","job_status":"done","queue_duration_s":0.135608,"scheduling_latency_s":0.135621,"redis_calls":7,"redis_duration_s":0.001205,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023584,"completed_at":"2026-08-15T23:45:13.855Z","load_balancing_strategy":"primary","db_duration_s":0.004298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.669785] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.857Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5aee1a403f22e75f5298ea38","created_at":"2026-08-15T23:45:13.705Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.707Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5aee1a403f22e75f5298ea38: start","job_status":"start","queue_duration_s":0.149927,"scheduling_latency_s":0.149943} gitlab # [ 248.670549] nix-daemon[2810]: accepted connection from pid 3470, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bab46e10efbb7ab90611caa355c0e1e6dec5cba9/statuses gitlab # [ 248.670971] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5aee1a403f22e75f5298ea38","created_at":"2026-08-15T23:45:13.705Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.707Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5aee1a403f22e75f5298ea38: done: 0.021622 sec","job_status":"done","queue_duration_s":0.149927,"scheduling_latency_s":0.149943,"redis_calls":10,"redis_duration_s":0.001302,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000368,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021622,"completed_at":"2026-08-15T23:45:13.878Z","load_balancing_strategy":"primary","db_duration_s":0.003909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.723611] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.879Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4fa8833bbfbc0227c3a4a8ba","created_at":"2026-08-15T23:45:13.707Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.708Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4fa8833bbfbc0227c3a4a8ba: start","job_status":"start","queue_duration_s":0.170956,"scheduling_latency_s":0.170971} gitlab # [ 248.724473] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4fa8833bbfbc0227c3a4a8ba","created_at":"2026-08-15T23:45:13.707Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.708Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4fa8833bbfbc0227c3a4a8ba: done: 0.019152 sec","job_status":"done","queue_duration_s":0.170956,"scheduling_latency_s":0.170971,"redis_calls":7,"redis_duration_s":0.000961,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019152,"completed_at":"2026-08-15T23:45:13.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.748815] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.900Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"829026216ef4ba0b919c6e63","created_at":"2026-08-15T23:45:13.709Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.711Z","job_size_bytes":19,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-829026216ef4ba0b919c6e63: start","job_status":"start","queue_duration_s":0.189233,"scheduling_latency_s":0.189248} gitlab # [ 248.761287] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"829026216ef4ba0b919c6e63","created_at":"2026-08-15T23:45:13.709Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.711Z","job_size_bytes":19,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-829026216ef4ba0b919c6e63: done: 0.021542 sec","job_status":"done","queue_duration_s":0.189233,"scheduling_latency_s":0.189248,"redis_calls":8,"redis_duration_s":0.001127,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021542,"completed_at":"2026-08-15T23:45:13.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.799668] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:13.980Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e73a40d90c360279808407d5","created_at":"2026-08-15T23:45:13.711Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.713Z","job_size_bytes":66,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e73a40d90c360279808407d5: start","job_status":"start","queue_duration_s":0.267681,"scheduling_latency_s":0.267711} gitlab # [ 248.839177] gitaly[924]: time="2026-08-15T23:45:14.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=43 command.spawn_token_fork_ms=40 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X1DRK66A7MR3M4930MDMB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:14.051" grpc.time_ms=44.742 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.840171] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 95 gitlab # [ 248.840704] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:14.001Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e73a40d90c360279808407d5","created_at":"2026-08-15T23:45:13.711Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.713Z","job_size_bytes":66,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e73a40d90c360279808407d5: done: 0.020515 sec","job_status":"done","queue_duration_s":0.267681,"scheduling_latency_s":0.267711,"redis_calls":7,"redis_duration_s":0.00128,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020515,"completed_at":"2026-08-15T23:45:14.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.855482] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:14.002Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8e27f981d3f77daeee0471dc","created_at":"2026-08-15T23:45:13.713Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.715Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8e27f981d3f77daeee0471dc: start","job_status":"start","queue_duration_s":0.287269,"scheduling_latency_s":0.287282} gitlab # [ 248.902640] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:14.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8e27f981d3f77daeee0471dc","created_at":"2026-08-15T23:45:13.713Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.715Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8e27f981d3f77daeee0471dc: done: 0.107172 sec","job_status":"done","queue_duration_s":0.287269,"scheduling_latency_s":0.287282,"redis_calls":7,"redis_duration_s":0.00102,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.081,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.067,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.107172,"completed_at":"2026-08-15T23:45:14.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.903683] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:14.110Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"83934eb3ba32bee3df38025f","created_at":"2026-08-15T23:45:13.717Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.719Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-83934eb3ba32bee3df38025f: start","job_status":"start","queue_duration_s":0.391505,"scheduling_latency_s":0.391524} gitlab # [ 248.915652] gitlab-workhorse[824]: time="2026-08-15T23:45:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 248.917035] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 50 gitlab # [ 248.918420] gitaly[924]: time="2026-08-15T23:45:14.149Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X1DVMX811NRYSY9XNPTXS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:14.140" pid=924 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 248.927095] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:14.127Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"83934eb3ba32bee3df38025f","created_at":"2026-08-15T23:45:13.717Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.719Z","job_size_bytes":3,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-83934eb3ba32bee3df38025f: done: 0.016824 sec","job_status":"done","queue_duration_s":0.391505,"scheduling_latency_s":0.391524,"redis_calls":7,"redis_duration_s":0.000985,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016824,"completed_at":"2026-08-15T23:45:14.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/bab46e10efbb7ab90611caa355c0e1e6dec5cba9/statuses, in 0.27 seconds) (finished: subtest: eval and build post commit statuses, in 1.37 seconds) (finished: run the VM test script, in 298.75 seconds) gitlab # [ 248.976322] sidekiq-cluster[2591]: {"severity":"INFO","time":"2026-08-15T23:45:14.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1a1930ac82f36f985bb14299","created_at":"2026-08-15T23:45:13.719Z","trace_propagation_headers":{"sentry-trace":"936e9fe1c0b84e9285bd9ad3dace1a10-e296397f5e914242","baggage":"sentry-trace_id=936e9fe1c0b84e9285bd9ad3dace1a10,sentry-release=Unknown"},"correlation_id":"01M03X1D1M49002YYH9HG42E36","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:13.720Z","job_size_bytes":6,"pid":2591,"sidekiq_tid":"m823","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1a1930ac82f36f985bb14299: start","job_status":"start","queue_duration_s":0.407769,"scheduling_latency_s":0.407783} gitlab # [ 248.977259] nix-daemon[2810]: accepted connection from pid 3499, user nixbot test script finished in 298.77s cleanup kill QemuMachine (pid 46) gitlab # [ 248.977641] gitaly[924]: time="2026-08-15T23:45:14.149Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M03X1DVMX811NRYSY9XNPTXS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:45:14.140" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=924 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 248.985505] sidekiq-clusterqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # [ (finished: cleanup, in 1.41 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-15T23:44:17.582Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'bab46e10efbb7ab90611caa355c0e1e6dec5cba9', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-15T23:45:12.394100Z', 'started_at': '2026-08-15T23:45:12.863365Z', 'finished_at': None}] [{'id': 5, 'sha': 'bab46e10efbb7ab90611caa355c0e1e6dec5cba9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:45:12.782Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'bab46e10efbb7ab90611caa355c0e1e6dec5cba9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-15T23:45:12.782Z', 'started_at': None, 'finished_at': '2026-08-15T23:45:13.395Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'bab46e10efbb7ab90611caa355c0e1e6dec5cba9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-15T23:45:13.550Z', 'started_at': None, 'finished_at': '2026-08-15T23:45:13.742Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]